-- Logs begin at Wed 2021-10-27 00:24:55 UTC, end at Wed 2021-10-27 01:38:26 UTC. -- Oct 27 01:10:27.763525 dv-cinder-815560-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 01:10:27.774246 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 01:10:27 2021] *** Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: nodename: dv-cinder-815560-1-iscsi Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: machine: x86_64 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: clock source: unix Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: pcre jit disabled Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: detected number of CPU cores: 4 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: current working directory: / Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: your processes number limit is 47680 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: your memory page size is 4096 bytes Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: detected max file descriptor number: 2048 Oct 27 01:10:27.774826 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: lock engine: pthread robust mutexes Oct 27 01:10:27.775562 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: thunder lock: enabled Oct 27 01:10:27.775562 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 01:10:27.775562 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 01:10:27.819573 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: Python main interpreter initialized at 0x5629495349c0 Oct 27 01:10:27.819573 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: python threads support enabled Oct 27 01:10:27.819573 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: your server socket listen backlog is limited to 100 connections Oct 27 01:10:27.819573 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:10:27.819931 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:10:27.820013 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: *** Operational MODE: preforking *** Oct 27 01:10:27.820243 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:10:27.820243 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: spawned uWSGI master process (pid: 101370) Oct 27 01:10:27.820440 dv-cinder-815560-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 01:10:27.824081 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: spawned uWSGI worker 1 (pid: 101371, cores: 1) Oct 27 01:10:27.824081 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: spawned uWSGI worker 2 (pid: 101372, cores: 1) Oct 27 01:10:27.824081 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:10:29.467662 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:29.467662 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: from cryptography.utils import int_from_bytes Oct 27 01:10:29.468333 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:29.468333 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: from cryptography.utils import int_from_bytes Oct 27 01:10:29.468789 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:29.468789 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: from cryptography.utils import int_from_bytes Oct 27 01:10:29.468929 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:29.468929 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: from cryptography.utils import int_from_bytes Oct 27 01:10:32.101317 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:10:32.101843 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:10:32.102212 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:10:32.102328 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:10:32.102409 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:10:32.102482 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:10:32.102555 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:10:32.102623 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:10:32.102694 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:10:32.102820 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:10:32.103010 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103195 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103334 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103515 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103652 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103831 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.103969 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.104146 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.104300 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.104471 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.104609 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.105321 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.105461 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.105658 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.105747 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106081 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106172 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106343 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106442 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106655 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106739 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.106966 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107067 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815560-1-iscsi {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107289 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107385 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815560-1-iscsi {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107593 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107685 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107892 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.107986 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108197 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108290 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108496 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108580 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108796 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.108879 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.109111 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.109204 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.109412 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.109614 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.109907 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110080 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110236 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110357 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110536 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110652 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.110854 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111032 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111174 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111328 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111464 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111592 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111763 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.111906 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112081 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112220 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112397 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112540 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112695 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112848 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.112997 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.113242 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815560-1-iscsi {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.113401 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815560-1-iscsi {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.113560 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.113871 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.113972 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.114208 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.114297 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.114514 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.114622 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.114922 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115016 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115225 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115314 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115526 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115619 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115838 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.115926 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116146 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116230 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116445 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116543 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116765 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.116851 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117076 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117163 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117390 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117485 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117688 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117780 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.117986 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118104 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118315 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118410 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118617 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118705 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.118919 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119005 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119216 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119315 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119459 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119551 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119742 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.119827 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.120043 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.120139 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.120358 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121070 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121376 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121522 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121702 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121802 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.121950 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122061 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122222 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122325 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122538 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122635 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122871 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.122970 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123156 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123250 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123459 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123545 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123762 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.123847 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124060 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124147 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124371 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124464 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124672 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124760 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.124972 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125058 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125272 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125357 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125584 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125676 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125891 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.125978 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126228 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126317 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126528 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126630 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126842 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.126935 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127168 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127254 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127464 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127561 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127765 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.127852 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128097 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128191 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128404 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128501 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128704 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.128789 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129016 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129102 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129322 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129429 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129618 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129702 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.129917 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130011 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130238 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130328 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130552 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130647 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.130878 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131226 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131392 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131486 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131679 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131776 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.131974 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132060 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132275 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132362 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132579 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132680 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132876 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.132961 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133175 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133263 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133470 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133555 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133763 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.133847 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134080 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134172 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134383 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134480 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134683 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134784 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.134982 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135067 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135282 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135369 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135578 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135674 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135878 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.135974 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.136224 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.136313 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.136524 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.136729 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.136823 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137057 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137143 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137368 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137454 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137676 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137767 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.137983 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138085 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138304 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138403 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138617 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138717 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.138917 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139065 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139210 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139296 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139518 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139609 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139809 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.139899 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140105 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140192 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140418 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140505 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140717 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.140803 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141017 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141103 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141332 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141424 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141623 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141714 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.141921 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142020 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142257 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142385 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142556 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142642 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142853 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.142956 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143151 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143237 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143447 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143532 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143741 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.143836 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144040 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144125 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144333 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144472 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144628 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144724 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.144920 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145006 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145232 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145316 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145542 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145627 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145841 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.145934 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146166 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146266 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146465 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146559 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146777 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.146871 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:32.147103 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.147197 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.147431 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.147517 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.147763 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.147849 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148070 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148167 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148398 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148493 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148721 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.148806 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149033 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149128 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149339 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149425 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149647 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149734 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.149966 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150114 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150297 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150384 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150603 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150692 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.150908 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151003 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151222 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151308 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151532 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151619 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.151894 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152050 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152204 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152379 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152512 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152700 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.152824 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153022 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153118 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153336 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153423 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153656 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153750 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.153986 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154249 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154343 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154430 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154635 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154735 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.154979 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155074 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155292 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155378 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155611 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155708 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.155917 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156004 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156228 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156321 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156532 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156630 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156836 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.156923 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157141 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157229 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157450 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157544 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157752 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.157838 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158076 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158179 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158396 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158483 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158702 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.158787 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159013 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159100 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159319 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159407 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159619 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159705 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.159921 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160015 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160222 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160316 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160518 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160604 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160819 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.160911 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161138 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161226 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161437 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161530 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161753 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.161914 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162072 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162161 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162381 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162479 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162696 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.162790 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163007 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163094 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163311 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163398 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163620 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163719 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.163928 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164014 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164228 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164313 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164540 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164685 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164841 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.164936 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165143 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165237 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165441 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165538 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165740 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.165870 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166067 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166168 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166374 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166461 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166677 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166770 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.166978 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.167064 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.167795 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.167923 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168128 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168215 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168439 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168534 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168747 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.168834 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169077 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169162 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169405 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169502 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169709 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.169796 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170043 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170144 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170375 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170471 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170678 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170763 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.170978 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171065 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171277 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171370 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171577 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171670 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171873 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.171958 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172172 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172268 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172472 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172559 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172769 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.172854 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173066 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173159 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173366 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173451 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173663 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173747 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.173963 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174069 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174293 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174389 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174592 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174680 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174892 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.174988 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175190 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175277 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175489 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175575 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175815 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.175909 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176126 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176220 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176465 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176561 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176776 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.176862 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177095 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177188 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177403 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177502 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177711 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.177797 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178013 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178170 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178339 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178439 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178646 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178732 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.178952 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179045 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179258 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179352 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179563 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179648 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179874 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.179966 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180177 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180263 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180489 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180574 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180791 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.180878 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181106 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181192 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181406 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181499 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181712 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.181799 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182045 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182184 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182384 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182471 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182719 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.182808 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.183664 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.183762 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.183976 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184065 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184287 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184381 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184596 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184683 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184903 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.184997 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185209 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185304 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185516 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185604 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185832 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.185925 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186174 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186283 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186488 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186583 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186797 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.186885 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187105 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187199 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187408 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187494 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187723 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.187809 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188025 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188164 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188329 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188430 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188642 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188729 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.188968 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189054 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189274 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189368 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189581 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189680 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189889 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.189975 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190217 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190314 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190524 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190611 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190830 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.190917 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191128 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191221 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191428 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191515 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191731 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.191826 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192041 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192126 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192348 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192443 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192653 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192747 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.192954 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193040 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193254 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193347 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193556 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193650 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193858 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.193945 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194182 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194285 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194486 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194572 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194796 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.194882 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195101 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195208 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195413 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195499 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195727 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.195813 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196026 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196121 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196327 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196423 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196632 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196717 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.196935 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197028 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197234 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197321 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197532 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197627 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197830 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.197917 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.198152 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.198301 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.198490 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.198578 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.198842 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199145 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199246 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199422 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199516 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199743 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.199844 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200048 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200140 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200353 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200440 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200659 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200746 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.200968 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201061 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201276 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201362 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201581 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201674 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201886 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.201974 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202215 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202312 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202517 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202604 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202822 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.202909 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203128 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203221 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203428 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203515 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203732 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.203819 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204036 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204130 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204334 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204421 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204636 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204722 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.204937 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.205071 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.205246 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.205495 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.205583 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.205820 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206124 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206228 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206455 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206551 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206764 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.206856 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207079 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207166 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207396 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207490 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207713 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.207799 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208017 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208103 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208319 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208405 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208626 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208713 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.208926 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209013 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209227 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209314 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209527 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209612 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209824 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.209910 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210146 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210235 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210447 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210546 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210747 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.210833 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211042 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211133 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211340 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211436 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211639 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211725 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.211941 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212034 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212261 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212371 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212559 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212647 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212867 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.212963 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213164 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213250 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213471 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213557 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213774 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.213861 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214103 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214220 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214428 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214539 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214725 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.214820 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215063 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215190 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215363 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215524 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215697 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.215792 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216013 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216099 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216346 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216441 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216648 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216734 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.216946 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217039 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217263 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217351 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217561 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217650 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217859 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.217953 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218180 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218270 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218485 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218571 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218782 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.218867 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219078 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219166 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219381 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219467 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219683 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219793 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.219987 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220075 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220289 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220375 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220585 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220679 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220887 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.220980 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221184 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221277 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221490 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221584 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221791 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.221878 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222108 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222199 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222407 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222503 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222709 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.222802 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223008 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223100 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223305 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223400 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223608 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223693 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223902 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.223988 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224207 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224294 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224502 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224587 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224800 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.224885 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225096 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225184 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225398 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225493 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225699 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225784 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.225995 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226111 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226326 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226412 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226630 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226725 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.226929 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227018 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227225 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227316 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227529 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227628 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227825 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.227911 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228122 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228208 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228421 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228554 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228725 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.228812 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229033 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229120 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229329 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229428 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229632 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.229719 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.230500 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.230604 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.230799 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231016 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231106 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231331 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231418 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231641 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231737 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.231947 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232041 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232249 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232342 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232547 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232642 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232842 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.232928 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233142 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233235 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233445 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233540 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233740 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.233826 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234091 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234183 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234361 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234462 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234669 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234762 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.234972 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235058 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235275 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235421 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235610 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235697 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235911 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.235997 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236222 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236309 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236528 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236615 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236833 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.236919 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237141 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237228 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237438 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237525 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237747 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.237841 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238070 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238160 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238373 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238457 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238669 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238765 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.238967 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239077 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239281 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239376 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239580 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239674 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239881 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.239966 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240195 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240282 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240501 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240595 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240812 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.240898 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241110 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241196 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241414 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241509 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241721 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.241809 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242060 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242151 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242351 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242451 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242655 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242742 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.242960 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243052 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243263 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243350 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243565 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243659 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243868 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.243963 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244173 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244262 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244473 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244568 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244774 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.244862 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.245076 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.245171 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.245372 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246170 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246323 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246411 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246676 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246778 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.246932 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247018 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247236 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247332 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247536 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247631 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247842 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.247936 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248140 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248240 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248513 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248599 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248827 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.248914 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249132 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249227 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249439 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249567 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249745 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.249879 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250075 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250212 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250386 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250562 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250695 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250824 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.250996 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.251135 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.251405 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.251492 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.251713 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.251857 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252004 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252139 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252313 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252450 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252593 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252727 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.252887 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253022 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253187 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253333 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253505 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253650 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253796 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.253931 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254110 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254255 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254400 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254547 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254710 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.254865 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255000 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255142 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255312 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255459 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255699 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.255843 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.256268 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.256379 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.256563 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.256662 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.256970 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257059 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257273 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257367 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257578 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257674 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257895 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.257981 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.258234 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.258322 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.258553 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.258642 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.258855 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259020 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259178 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259331 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259481 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259628 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259772 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.259908 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260044 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260178 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260348 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260488 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260656 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260794 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.260954 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261124 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261333 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261430 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261646 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261855 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.261993 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262202 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262293 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262523 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262613 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262905 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.262991 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.263226 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.263314 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.263613 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.263786 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.263942 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264030 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264251 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264337 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264558 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264645 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264860 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.264947 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265168 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265255 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265470 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265557 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265768 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.265855 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266091 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266182 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266398 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266487 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266703 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.266790 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267011 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267121 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267313 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267402 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267612 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267700 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.267912 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268008 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268211 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268298 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268514 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268602 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268828 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.268922 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269125 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269212 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269440 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269526 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269750 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.269845 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270070 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270160 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270392 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270488 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270698 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270787 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.270996 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271130 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271294 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271382 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271592 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271680 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271890 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.271975 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272188 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272282 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272521 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272633 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272822 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.272914 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273140 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273235 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273450 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273537 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273778 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.273872 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274107 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274211 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274419 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274516 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274732 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.274821 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275050 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275145 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275348 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275435 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275646 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275733 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.275950 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276054 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276250 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276337 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276545 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276686 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.276874 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277057 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277209 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277372 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277483 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277674 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277772 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.277976 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278128 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278301 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278436 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278621 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278740 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.278921 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279046 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279237 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279347 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279544 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279668 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279844 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.279975 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280145 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280278 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280445 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280581 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280784 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.280874 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281084 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281212 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281413 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281502 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281725 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.281813 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282078 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282172 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282386 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282476 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282693 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.282794 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283012 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283100 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283323 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283412 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283634 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283724 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.283945 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284032 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284256 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284346 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284564 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284651 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284875 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.284970 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285181 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285267 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285485 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285580 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285790 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.285886 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286129 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286219 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286442 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286531 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286755 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.286954 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287279 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287377 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287587 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287683 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287895 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.287992 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288206 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288293 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288511 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288606 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288819 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.288908 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289125 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289212 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289430 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289516 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289732 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.289819 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290058 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290148 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290368 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290467 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290686 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.290774 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291003 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291089 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291326 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291423 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291634 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291722 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.291943 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.292030 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.292965 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293081 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293163 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293338 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293478 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293702 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.293805 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294017 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294126 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294348 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294448 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294663 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294759 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.294980 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295067 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295295 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295390 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295605 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295692 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.295913 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296013 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296223 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296317 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296530 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296618 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296839 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.296940 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297145 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297247 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297454 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297553 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297762 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.297849 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298107 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298212 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298442 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298529 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298758 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.298846 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299066 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299161 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299378 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299466 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299687 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.299816 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300200 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300297 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300509 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300602 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300834 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.300920 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301154 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301249 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301476 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301575 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301791 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.301889 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302136 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302266 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302466 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302557 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302775 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.302872 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303075 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303162 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303382 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303468 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303685 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303771 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.303985 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304072 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304300 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304386 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304607 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304695 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304907 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.304994 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.305218 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.305303 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.305523 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.305618 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306073 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306164 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306420 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306505 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306735 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.306880 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307059 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307145 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307382 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307484 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307700 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.307809 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.308555 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.308701 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.308890 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.308978 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309197 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309299 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309503 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309591 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309817 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.309953 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310151 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310243 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310458 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310545 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310761 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.310848 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311073 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311162 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311379 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311466 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311682 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311777 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.311989 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312079 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312286 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312401 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312609 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312702 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312910 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.312998 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313211 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313296 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313514 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313609 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313821 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.313915 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314146 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314249 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314449 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314613 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314753 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.314840 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315051 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315138 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315359 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315457 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315657 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315751 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.315963 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316049 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316261 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316405 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316568 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316656 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316868 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.316964 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317176 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317265 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317475 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317561 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317794 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.317892 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318119 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318210 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318422 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318509 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318732 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.318819 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319039 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319128 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319357 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319443 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319665 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319751 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.319970 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.320057 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.320314 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.320404 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.320625 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.320720 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321149 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321235 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321524 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321661 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321847 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.321942 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322206 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322297 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322547 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322633 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322852 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.322948 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.323155 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.323250 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.323458 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.323567 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.323852 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324007 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324166 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324325 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324481 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324639 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324792 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.324950 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325103 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325259 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325416 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325569 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325728 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.325878 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326050 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326211 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326368 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326519 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326679 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.326826 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327024 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327163 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327342 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327481 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327661 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327866 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.327975 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328116 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328278 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328431 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328588 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328739 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.328897 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329046 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329205 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329354 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329514 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329660 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329829 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.329972 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330201 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330312 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330517 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330626 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330823 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.330931 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331240 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331336 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331554 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331641 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331871 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.331970 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332191 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332280 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332511 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332605 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332833 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.332930 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333156 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333243 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333467 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333553 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333781 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.333876 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334111 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334203 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334438 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334524 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334773 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.334871 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335097 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335191 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335415 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335510 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335717 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.335811 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336016 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336111 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336314 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336402 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336621 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336708 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.336948 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337034 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337259 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337348 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337576 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337663 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.337881 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338043 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338225 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338312 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338532 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338620 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338848 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.338973 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.339186 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.339285 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.339502 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.339701 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.339810 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340014 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340138 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340342 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340434 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340650 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340744 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.340957 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341045 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341267 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341357 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341574 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341670 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341879 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.341966 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342260 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342359 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342582 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342670 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342885 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.342979 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343191 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343277 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343510 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343603 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343821 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.343951 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344133 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344219 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344442 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344529 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344746 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.344840 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345065 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345151 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345367 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345453 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345673 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345759 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.345975 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.346152 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.346304 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.346404 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.346616 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.346946 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.347272 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.347597 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.347684 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.347923 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348020 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348268 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348365 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348579 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348675 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.348926 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.349014 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.349253 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.349346 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.349497 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:10:32.349585 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.349891 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.350271 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.350600 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:32.350843 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:10:32.374262 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_db.sqlalchemy.engines [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.375349 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_db.sqlalchemy.engines [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.550551 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.context [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0f3d9c-730f-4da5-86cf-eb2d1921af52(cell1) {{(pid=101372) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:10:32.554884 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_concurrency.lockutils [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:10:32.556444 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_concurrency.lockutils [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:10:32.557236 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_concurrency.lockutils [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:10:32.557902 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.context [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0f3d9c-730f-4da5-86cf-eb2d1921af52(cell1) {{(pid=101371) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:10:32.559397 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_concurrency.lockutils [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:10:32.562277 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:10:32.563818 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:10:32.564615 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:10:32.566789 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:10:32.569723 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_db.sqlalchemy.engines [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.570803 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_db.sqlalchemy.engines [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.579887 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_db.sqlalchemy.engines [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.582219 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_db.sqlalchemy.engines [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.831969 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG oslo_db.sqlalchemy.engines [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:32.843556 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_db.sqlalchemy.engines [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:10:33.225210 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: WARNING keystonemiddleware.auth_token [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:10:33.231658 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: WARNING keystonemiddleware.auth_token [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:10:33.248739 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: WARNING keystonemiddleware.auth_token [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:10:33.255481 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: WARNING keystonemiddleware.auth_token [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:10:33.576332 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: WARNING keystonemiddleware.auth_token [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:10:33.581330 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: WARNING keystonemiddleware.auth_token [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:10:33.587371 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629495349c0 pid: 101372 (default app) Oct 27 01:10:33.590045 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:10:33.591212 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002323 Oct 27 01:10:33.591613 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Wed Oct 27 01:10:33 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:10:33.601295 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: WARNING keystonemiddleware.auth_token [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:10:33.606571 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: WARNING keystonemiddleware.auth_token [None req-e290d60d-dd31-4281-b9eb-ac9b18b03e6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:10:33.612706 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629495349c0 pid: 101371 (default app) Oct 27 01:11:59.244311 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:11:59.245827 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002716 Oct 27 01:11:59.250104 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:11:59 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:11:59.684610 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-684f68f7-919b-411b-8020-2f54b43ea0a8 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:11:59.714404 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-684f68f7-919b-411b-8020-2f54b43ea0a8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.460101 Oct 27 01:11:59.726079 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1291 bytes} [Wed Oct 27 01:11:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:12:02.040076 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:02.041218 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-0271baaf-b26b-490b-99fd-0ab0e97392fc None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Oct 27 01:12:02.046390 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:02 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:02.101605 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-e7711b51-6f4b-4fde-b38f-fce48cd9491c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:02.119922 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:12:02.119922 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:12:02.253320 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-e7711b51-6f4b-4fde-b38f-fce48cd9491c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.204803 Oct 27 01:12:02.254052 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:02.475043 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-e2fe6a50-fc52-41e9-8eb1-0b8e4ea12a62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:02.477416 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:12:02.477416 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: warnings.warn(msg) Oct 27 01:12:02.634709 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-e2fe6a50-fc52-41e9-8eb1-0b8e4ea12a62 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370978 Oct 27 01:12:02.635912 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1335 bytes} [Wed Oct 27 01:12:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:12:04.993693 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-e7711b51-6f4b-4fde-b38f-fce48cd9491c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:04.995133 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-e7711b51-6f4b-4fde-b38f-fce48cd9491c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Oct 27 01:12:04.996520 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:05.118954 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-b7b03fbe-7b02-4899-89c2-2a8d09348bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "swap": 0}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:05.137425 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:12:05.137425 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: warnings.warn(msg) Oct 27 01:12:05.247566 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-b7b03fbe-7b02-4899-89c2-2a8d09348bbe admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.245264 Oct 27 01:12:05.248367 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:05.264685 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-3820f41f-b0d5-4411-949d-73cad51a4987 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:05.266398 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:12:05.266398 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:12:05.387705 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-3820f41f-b0d5-4411-949d-73cad51a4987 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130243 Oct 27 01:12:05.388587 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1335 bytes} [Wed Oct 27 01:12:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:12:07.716125 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-b7b03fbe-7b02-4899-89c2-2a8d09348bbe admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:07.717142 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-b7b03fbe-7b02-4899-89c2-2a8d09348bbe admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 27 01:12:07.717767 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:07.782513 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-a71999cc-3150-40b6-8abd-5051b955bd01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:07.881332 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-a71999cc-3150-40b6-8abd-5051b955bd01 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156564 Oct 27 01:12:07.881877 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:07.895146 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-ec03dfda-0fe9-4a48-87fd-256356f1fc93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:08.007413 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-ec03dfda-0fe9-4a48-87fd-256356f1fc93 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115924 Oct 27 01:12:08.008003 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1335 bytes} [Wed Oct 27 01:12:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:12:10.323341 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-a71999cc-3150-40b6-8abd-5051b955bd01 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:10.325115 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-a71999cc-3150-40b6-8abd-5051b955bd01 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Oct 27 01:12:10.326269 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:10 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:10.387616 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-6f09401f-8479-40f3-8471-7c747e0f639a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:10.478081 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-6f09401f-8479-40f3-8471-7c747e0f639a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144438 Oct 27 01:12:10.478762 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:10.491077 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-25a25f32-ee83-441a-bddb-a4f906bc3fa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:10.593878 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-25a25f32-ee83-441a-bddb-a4f906bc3fa4 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106407 Oct 27 01:12:10.594487 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1335 bytes} [Wed Oct 27 01:12:10 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:12:12.947478 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-6f09401f-8479-40f3-8471-7c747e0f639a admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:12.948474 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-6f09401f-8479-40f3-8471-7c747e0f639a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Oct 27 01:12:12.948870 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:13.018971 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:13.122262 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166576 Oct 27 01:12:13.122817 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:13.137048 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-ab728850-9a83-49f1-be0a-eab5311f700f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:13.247881 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-ab728850-9a83-49f1-be0a-eab5311f700f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115551 Oct 27 01:12:13.248480 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1335 bytes} [Wed Oct 27 01:12:13 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:12:15.575824 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:15.576872 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 27 01:12:15.577268 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:15.639326 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-daed2bd5-aa96-4441-a84c-830b69374364 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:15.661646 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-daed2bd5-aa96-4441-a84c-830b69374364 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077590 Oct 27 01:12:15.662201 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1291 bytes} [Wed Oct 27 01:12:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:12:17.950754 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:17.952048 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4a28bf78-e890-4c4f-b15d-040c94925e09 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Oct 27 01:12:17.952574 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:18.017001 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-27e9f7a0-2020-4195-bb8b-9be13f7da59c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:18.105251 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-27e9f7a0-2020-4195-bb8b-9be13f7da59c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146332 Oct 27 01:12:18.105953 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:17 2021] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:12:18.118392 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-e16e61c5-89bf-4bee-a95c-16660e6172b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:18.263453 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-e16e61c5-89bf-4bee-a95c-16660e6172b0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148588 Oct 27 01:12:18.264269 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1332 bytes} [Wed Oct 27 01:12:18 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:12:21.046108 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-27e9f7a0-2020-4195-bb8b-9be13f7da59c admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:21.047126 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-27e9f7a0-2020-4195-bb8b-9be13f7da59c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 27 01:12:21.047533 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:21.108493 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-f20148e1-19cd-4b29-83a6-1975cfe37b14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:21.205653 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-f20148e1-19cd-4b29-83a6-1975cfe37b14 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150965 Oct 27 01:12:21.206346 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:21.224768 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d65691d7-0c18-4edb-852c-d2df589cfab8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:21.312744 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d65691d7-0c18-4edb-852c-d2df589cfab8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097555 Oct 27 01:12:21.313324 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1332 bytes} [Wed Oct 27 01:12:21 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:12:23.621086 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-f20148e1-19cd-4b29-83a6-1975cfe37b14 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:23.622227 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-f20148e1-19cd-4b29-83a6-1975cfe37b14 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 27 01:12:23.622637 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:23.682221 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-cc2a572f-d952-4e7a-be2b-07a224cbd6fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:23.799703 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-cc2a572f-d952-4e7a-be2b-07a224cbd6fe admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.170238 Oct 27 01:12:23.800484 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:23 2021] POST /compute/v2.1/flavors => generated 406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:23.813865 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-8b9d5d0f-4065-47e7-bdab-eb35d24045b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:23.929229 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-8b9d5d0f-4065-47e7-bdab-eb35d24045b0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119057 Oct 27 01:12:23.929864 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1332 bytes} [Wed Oct 27 01:12:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:12:26.259706 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-cc2a572f-d952-4e7a-be2b-07a224cbd6fe admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:26.261293 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-cc2a572f-d952-4e7a-be2b-07a224cbd6fe admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Oct 27 01:12:26.261690 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:26 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:12:26.323975 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-90ce41b1-3f73-4306-8a22-cee187f7936c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:26.440236 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-90ce41b1-3f73-4306-8a22-cee187f7936c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.171958 Oct 27 01:12:26.441040 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:12:26.454409 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-e0cbf744-ef81-424b-b690-e038fa0e4474 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:26.555468 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-e0cbf744-ef81-424b-b690-e038fa0e4474 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104158 Oct 27 01:12:26.556524 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1332 bytes} [Wed Oct 27 01:12:26 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:12:28.889981 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-90ce41b1-3f73-4306-8a22-cee187f7936c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:12:28.891012 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-90ce41b1-3f73-4306-8a22-cee187f7936c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 27 01:12:28.891602 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:12:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:12:28.954050 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:29.036954 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138835 Oct 27 01:12:29.037865 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1282 bytes} [Wed Oct 27 01:12:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:29.051382 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-44552c0d-d281-4f0f-bf20-a12751830869 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:12:29.168585 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-44552c0d-d281-4f0f-bf20-a12751830869 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121017 Oct 27 01:12:29.169211 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1332 bytes} [Wed Oct 27 01:12:29 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:13:08.763060 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:08.764051 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 27 01:13:08.764432 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:13:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:08.821503 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-404f55a4-a92c-4ae6-9006-ce479e0dfdfb admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:08.838273 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-404f55a4-a92c-4ae6-9006-ce479e0dfdfb admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067125 Oct 27 01:13:08.838805 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1291 bytes} [Wed Oct 27 01:13:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:13:10.487977 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:10.488969 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-e9a718e1-db6d-4913-950d-e7df154da66b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 27 01:13:10.489364 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:10.680436 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-64eb0371-bb33-4497-8c48-4975ca671707 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:10.685748 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.wsgi [None req-64eb0371-bb33-4497-8c48-4975ca671707 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 01:13:10.686358 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-64eb0371-bb33-4497-8c48-4975ca671707 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:10.687104 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-64eb0371-bb33-4497-8c48-4975ca671707 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058036 Oct 27 01:13:10.687603 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1190 bytes} [Wed Oct 27 01:13:10 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:10.697410 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-b4791ae4-3bd5-4708-830d-89e13e8f585f admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:10.717980 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-b4791ae4-3bd5-4708-830d-89e13e8f585f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024182 Oct 27 01:13:10.718545 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:13:10.729118 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4ec30b35-83e9-42cc-a56a-033256b39a11 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:10.749910 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4ec30b35-83e9-42cc-a56a-033256b39a11 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024267 Oct 27 01:13:10.750755 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:13:10.761131 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-2af6094b-8295-456d-91a5-c03f690d7c48 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:10.766523 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.wsgi [None req-2af6094b-8295-456d-91a5-c03f690d7c48 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 01:13:10.767107 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-2af6094b-8295-456d-91a5-c03f690d7c48 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:10.767906 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-2af6094b-8295-456d-91a5-c03f690d7c48 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010266 Oct 27 01:13:10.768386 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1190 bytes} [Wed Oct 27 01:13:10 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:12.171346 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4ec30b35-83e9-42cc-a56a-033256b39a11 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:12.172336 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4ec30b35-83e9-42cc-a56a-033256b39a11 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 27 01:13:12.172721 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:12.363396 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-a4d9ddf2-eeae-4f87-bd79-3ae2c18c6a0a admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:12.369125 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.wsgi [None req-a4d9ddf2-eeae-4f87-bd79-3ae2c18c6a0a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 01:13:12.369679 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-a4d9ddf2-eeae-4f87-bd79-3ae2c18c6a0a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:12.370503 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-a4d9ddf2-eeae-4f87-bd79-3ae2c18c6a0a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057774 Oct 27 01:13:12.370999 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1190 bytes} [Wed Oct 27 01:13:12 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:12.380992 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-4c65d977-e5fb-4476-af0f-91a776238bf8 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:12.394081 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-4c65d977-e5fb-4476-af0f-91a776238bf8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016564 Oct 27 01:13:12.394587 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:13:12.404762 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-c1842b6e-d745-417f-9801-128213e596ab admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:12.418415 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-c1842b6e-d745-417f-9801-128213e596ab admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017000 Oct 27 01:13:12.418925 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:13:12.428533 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-6451a7bf-bf97-4403-aa20-f6820f0d57ea admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:12.433606 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.wsgi [None req-6451a7bf-bf97-4403-aa20-f6820f0d57ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 01:13:12.434193 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-6451a7bf-bf97-4403-aa20-f6820f0d57ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:12.434952 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-6451a7bf-bf97-4403-aa20-f6820f0d57ea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009952 Oct 27 01:13:12.435430 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1190 bytes} [Wed Oct 27 01:13:12 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:13.851190 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-c1842b6e-d745-417f-9801-128213e596ab admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:13.852179 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-c1842b6e-d745-417f-9801-128213e596ab admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Oct 27 01:13:13.852567 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:13:14.042503 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-2a1e245e-245c-4ed1-80bf-4315ede275b8 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:14.048079 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.wsgi [None req-2a1e245e-245c-4ed1-80bf-4315ede275b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 01:13:14.048630 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-2a1e245e-245c-4ed1-80bf-4315ede275b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:14.049402 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-2a1e245e-245c-4ed1-80bf-4315ede275b8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059516 Oct 27 01:13:14.049896 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:13:13 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:14.060317 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-bbfa0b65-83e3-4fa2-ab67-9036355fa40a admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:14.073492 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-bbfa0b65-83e3-4fa2-ab67-9036355fa40a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016750 Oct 27 01:13:14.074010 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:13:14.083628 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:14.096572 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016355 Oct 27 01:13:14.097082 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1210 bytes} [Wed Oct 27 01:13:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:13:14.107172 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-7be45e55-247b-42e8-82de-446942edd05f admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:14.112195 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.wsgi [None req-7be45e55-247b-42e8-82de-446942edd05f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 01:13:14.112749 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-7be45e55-247b-42e8-82de-446942edd05f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:13:14.113514 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-7be45e55-247b-42e8-82de-446942edd05f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009823 Oct 27 01:13:14.113989 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:13:14 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:15.530204 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:15.531210 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 27 01:13:15.531597 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:15.722180 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-7097acbe-da2c-4a5d-8315-4b0141c2ba15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:13:15.810894 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-7097acbe-da2c-4a5d-8315-4b0141c2ba15 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.139435 Oct 27 01:13:15.811358 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1235 bytes} [Wed Oct 27 01:13:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:13:17.237399 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:17.238429 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 27 01:13:17.238818 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:17.431113 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-5b7f6523-c56f-4eb7-8fac-fa8cebcb4393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:13:17.519410 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-5b7f6523-c56f-4eb7-8fac-fa8cebcb4393 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.139838 Oct 27 01:13:17.519963 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1235 bytes} [Wed Oct 27 01:13:17 2021] POST /compute/v2.1/flavors => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:13:18.941727 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:18.942757 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 27 01:13:18.943930 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:19.141516 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-1d941b7b-cf1e-48f1-81cc-8874c568d41e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:13:19.217164 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-1d941b7b-cf1e-48f1-81cc-8874c568d41e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.126743 Oct 27 01:13:19.217703 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1235 bytes} [Wed Oct 27 01:13:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:13:20.640019 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:20.641024 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 27 01:13:20.641415 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:20.832619 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-809e95de-fc02-49a7-86f7-ed2160a6e45c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:13:20.896927 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-809e95de-fc02-49a7-86f7-ed2160a6e45c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.114607 Oct 27 01:13:20.897471 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1235 bytes} [Wed Oct 27 01:13:20 2021] POST /compute/v2.1/flavors => generated 409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:13:22.357866 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:22.360260 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Oct 27 01:13:22.360260 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:13:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:13:22.559205 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-616b48ae-3440-4b20-a1fa-4cf8a369932a admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:13:22.577828 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-616b48ae-3440-4b20-a1fa-4cf8a369932a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070285 Oct 27 01:13:22.578321 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1202 bytes} [Wed Oct 27 01:13:22 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:14:09.173860 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.175414 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-815eb0e6-1b92-400a-86fd-feebec71753c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 27 01:14:09.175933 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 930 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:14:09.233687 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-20a53a5d-5cb1-46c3-bd41-f5fc38a610ac admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.254810 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-20a53a5d-5cb1-46c3-bd41-f5fc38a610ac admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071750 Oct 27 01:14:09.254810 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1291 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:14:09.277122 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-729a84bf-ddbd-4abd-b0ae-3b20f12e5ebe admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.284908 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-729a84bf-ddbd-4abd-b0ae-3b20f12e5ebe admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011357 Oct 27 01:14:09.285458 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 32/65] 10.222.0.32 () {60 vars in 1282 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:14:09.298112 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-a9623a1a-89e7-48b0-a4af-c228dbaeb760 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.306456 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-a9623a1a-89e7-48b0-a4af-c228dbaeb760 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012191 Oct 27 01:14:09.306970 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1285 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:14:09.319189 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-11f445c0-7875-4368-b55b-bc0ff0916313 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.326593 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-11f445c0-7875-4368-b55b-bc0ff0916313 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011504 Oct 27 01:14:09.327097 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1285 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:14:09.339989 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:14:09.347663 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011176 Oct 27 01:14:09.348161 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1282 bytes} [Wed Oct 27 01:14:09 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:15:39.284308 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-5c71bf1c-b663-4175-b456-297c6759a98e tempest-verify_tempest_config-1495341970 tempest-verify_tempest_config-1495341970-project] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:15:39.286274 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-5c71bf1c-b663-4175-b456-297c6759a98e tempest-verify_tempest_config-1495341970 tempest-verify_tempest_config-1495341970-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106962 Oct 27 01:15:39.286801 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 34/69] 10.222.0.32 () {58 vars in 1133 bytes} [Wed Oct 27 01:15:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:11.606232 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:11.607271 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Oct 27 01:17:11.607668 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:17:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:11.859044 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:11.860214 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:17:11.860214 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:17:11.861749 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:11.862207 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:11.863114 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:11.863532 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:11.896860 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-b691180b-fff7-40d2-8a93-95db3814eb82 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147617 Oct 27 01:17:11.897402 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:17:11 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:13.326285 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:13.327274 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 27 01:17:13.327664 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:17:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:13.517959 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:13.519135 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:17:13.519135 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:17:13.520608 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:13.521040 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:13.521799 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:13.522250 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:13.541486 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-99bf3eb0-175b-46db-97c6-6f99bcefbb02 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074350 Oct 27 01:17:13.541965 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 36/73] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:17:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:25.407723 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:25.408719 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 27 01:17:25.409485 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 38/74] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:17:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:25.601468 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:25.602679 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:17:25.602679 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:17:25.604158 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:25.605499 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:25.606323 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:25.606750 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:25.630747 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-91918b28-c964-4760-aeb6-de9789273b55 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079125 Oct 27 01:17:25.631224 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 37/75] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:17:25 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:27.062793 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: DEBUG nova.api.openstack.wsgi [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] Calling method '>' {{(pid=101372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:27.063791 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: INFO nova.api.openstack.requestlog [None req-d0541b1f-8a8c-44b4-a391-2eb79249be70 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 27 01:17:27.064184 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: [pid: 101372|app: 0|req: 39/76] 10.222.0.32 () {56 vars in 1074 bytes} [Wed Oct 27 01:17:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:27.258639 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG nova.api.openstack.wsgi [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] Calling method '>' {{(pid=101371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:27.259810 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:17:27.259810 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: warnings.warn(msg) Oct 27 01:17:27.262117 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:27.262560 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:27.263343 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:17:27.263797 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: DEBUG oslo_concurrency.lockutils [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:17:27.285663 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: INFO nova.api.openstack.requestlog [None req-a589e9a2-4143-435b-b31d-bbd41109a2d8 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078917 Oct 27 01:17:27.286245 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: [pid: 101371|app: 0|req: 38/77] 10.222.0.32 () {60 vars in 1193 bytes} [Wed Oct 27 01:17:27 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:18:25.510153 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: Wed Oct 27 01:18:25 2021 - graceful shutdown triggered... Oct 27 01:18:25.510796 dv-cinder-815560-1-iscsi devstack@n-api.service[101371]: Gracefully killing worker 1 (pid: 101371)... Oct 27 01:18:25.510204 dv-cinder-815560-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 01:18:25.512455 dv-cinder-815560-1-iscsi devstack@n-api.service[101372]: Gracefully killing worker 2 (pid: 101372)... Oct 27 01:18:26.511219 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: worker 1 buried after 1 seconds Oct 27 01:18:26.511219 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: worker 2 buried after 1 seconds Oct 27 01:18:26.511219 dv-cinder-815560-1-iscsi devstack@n-api.service[101370]: goodbye to uWSGI. Oct 27 01:18:26.512814 dv-cinder-815560-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 01:18:26.513362 dv-cinder-815560-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 01:18:26.516192 dv-cinder-815560-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 01:18:26.528031 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 01:18:26 2021] *** Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: nodename: dv-cinder-815560-1-iscsi Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: machine: x86_64 Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: clock source: unix Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: pcre jit disabled Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: detected number of CPU cores: 4 Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: current working directory: / Oct 27 01:18:26.530076 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: your processes number limit is 47680 Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: your memory page size is 4096 bytes Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: detected max file descriptor number: 2048 Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: lock engine: pthread robust mutexes Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: thunder lock: enabled Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 01:18:26.530752 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 01:18:26.582175 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: Python main interpreter initialized at 0x55adc70e99c0 Oct 27 01:18:26.582175 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: python threads support enabled Oct 27 01:18:26.582175 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: your server socket listen backlog is limited to 100 connections Oct 27 01:18:26.582175 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:18:26.582575 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:18:26.582575 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: *** Operational MODE: preforking *** Oct 27 01:18:26.582836 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:18:26.582836 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: spawned uWSGI master process (pid: 116330) Oct 27 01:18:26.583058 dv-cinder-815560-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 01:18:26.586078 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: spawned uWSGI worker 1 (pid: 116348, cores: 1) Oct 27 01:18:26.586078 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: spawned uWSGI worker 2 (pid: 116349, cores: 1) Oct 27 01:18:26.586078 dv-cinder-815560-1-iscsi devstack@n-api.service[116330]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:18:28.425868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:18:28.425868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: from cryptography.utils import int_from_bytes Oct 27 01:18:28.456231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:18:28.456231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: from cryptography.utils import int_from_bytes Oct 27 01:18:28.463336 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:18:28.463336 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: from cryptography.utils import int_from_bytes Oct 27 01:18:28.464094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:18:28.464094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: from cryptography.utils import int_from_bytes Oct 27 01:18:31.045096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:18:31.045662 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:18:31.045890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:18:31.046191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:18:31.046444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:18:31.046827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.047158 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.047482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.047800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.048134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.048445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.048765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.049086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.049417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.049674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.049988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.050334 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815560-1-iscsi {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.050660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.050967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.051275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.051589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.051894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.052214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.052518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.053014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.054437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.054437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.054437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.054711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.054791 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:18:31.055168 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:18:31.055706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.055706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.055875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:18:31.055960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.056033 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:18:31.056113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.056191 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:18:31.056279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.056589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.056712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.056799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815560-1-iscsi {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.057918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.058202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.058423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.058674 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.058890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.059110 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.059337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.059556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.059556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.059959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.060175 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.060394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.060612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815560-1-iscsi {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.060817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.061025 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.061244 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.061463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.061698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.061914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.062145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.062384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.062604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.062782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.062989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.063991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.064974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065280 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065634 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065828 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.065992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.066169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.066169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.066466 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.066620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.066940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.068020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.068410 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.068574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.068730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.068884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815560-1-iscsi {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069835 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.069990 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070208 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070891 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.070983 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071362 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.071912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.072547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073124 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073220 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073499 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073766 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.073948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074175 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074367 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074632 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.074964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075800 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.075948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076573 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.076996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.077201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.077309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.077667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.077917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078416 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078508 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.078879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.079895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080241 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080547 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.080852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081475 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.081994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082329 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.082948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.083921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084538 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.084845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085351 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.085747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.086962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087580 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.087926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.088094 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.088221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.088889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.088995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089310 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.089986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090206 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090637 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.090942 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.091177 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.091308 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.091518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.091639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.091828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.091948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.092152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.092278 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.092459 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.092587 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.092764 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.092893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.093082 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.093203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.093390 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.093518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.093799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.093962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.094265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.095010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.095010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.095245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.095369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.095481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.095599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.095715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.095834 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.095964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.096314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.096314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.096501 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.096593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.096688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.096784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.096868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.096951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.097033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.097116 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.097213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.097306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.097399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.097515 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.097610 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.097868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.098010 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.099052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.099228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.099454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.099583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.099693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.099781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.099871 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.099871 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:18:31.100021 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100169 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.100941 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101060 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101272 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101371 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101591 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.101905 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102244 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102572 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.102977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103297 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.103939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.104244 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.104372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.104576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.104712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.104895 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105335 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.105942 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106199 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106835 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.106929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.107145 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.107238 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.107484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.107643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.107793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108076 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108727 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.108937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109261 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109581 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.109981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.110925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111545 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.111859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.112071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.112427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.112630 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.112729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.112937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113029 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113346 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.113967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114537 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114635 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114846 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.114948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115161 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115563 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.115868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116464 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116779 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.116983 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.117894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118194 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118654 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.118923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.119922 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120220 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.120856 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121727 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.121826 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122067 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122478 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.122781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123412 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.123918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124629 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.124937 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125240 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125547 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.125851 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126394 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.126801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.127947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128328 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128438 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.128985 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.129200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.129302 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.129512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.129613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.130372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.130517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.130631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.130768 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.130889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.131978 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132284 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.132914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133537 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133637 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.133950 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134501 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134622 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.134914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.135647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.135757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.135956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.136884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137076 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137179 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137397 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.137816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.138983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139293 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139717 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.139918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140023 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.140975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141264 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141571 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.141866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142746 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.142838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143064 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.143990 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144298 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144607 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144700 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.144916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145007 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145637 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.145931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.146882 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.147808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148029 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.148947 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149051 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.149959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.150217 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.150468 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.150570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.151396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.151503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.151647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.151831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.151966 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.152909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153131 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.153870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154111 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.154822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.155952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156362 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156565 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.156971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157494 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157804 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.157903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158564 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158807 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.158894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159164 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159627 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.159959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160060 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.160991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161307 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161671 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161869 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.161986 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162595 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.162912 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163719 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.163818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164022 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164329 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164629 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.164936 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165340 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165642 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165846 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.165950 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.166171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.166281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.166599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.166701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.166985 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167234 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167611 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167821 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.167927 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.168937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169154 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169635 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.169950 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170582 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.170887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171029 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171663 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.171971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.172878 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173187 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.173956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174296 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174462 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174619 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.174933 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175077 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175236 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.175848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176311 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176456 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.176917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177534 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177666 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.177968 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.178171 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.178295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.178476 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.178654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.178957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179166 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179387 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179486 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179776 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.179984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180101 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180601 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.180925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181365 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181545 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.181850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.182542 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.182731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.182859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.183979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.184926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185225 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.185839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186161 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186370 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186672 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.186976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187677 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.187995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.188203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.188294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.188507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.188605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.188807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189176 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189730 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.189836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190417 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.190820 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191162 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191434 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.191955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192261 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.192962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.193892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194555 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.194851 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.195821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196025 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.196946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.197051 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.197256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.197355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.197582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.198387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.198476 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.198742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.198849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199021 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199338 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199434 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199662 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199891 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.199992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200298 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.200902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201770 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.201862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202241 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.202960 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.203215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.203388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.203528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.203700 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.203841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.204947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205583 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.205891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206659 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.206973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.207993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208526 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.208930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209771 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.209872 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.210858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211175 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.211837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212142 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212296 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212608 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212770 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.212920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213251 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213482 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.213949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214078 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214179 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.214856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215158 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215465 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.215994 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216084 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.216923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217873 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.217974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218308 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218851 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.218950 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219282 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.219901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220208 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220412 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.220822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221027 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221220 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.221944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.222878 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223030 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223659 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.223973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224718 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.224924 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225248 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225691 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225866 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.225970 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226594 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226823 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.226921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227459 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227553 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.227872 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228734 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.228885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.229994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230416 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230765 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.230934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231542 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.231849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232167 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.232807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233341 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233469 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.233955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.234908 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.235946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236293 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.236929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.237419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.237594 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.237732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.237833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238188 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238476 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.238796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.239953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240369 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.240987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.241196 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.241301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.241510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.241601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.241819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242066 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242403 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.242898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243033 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243347 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243662 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.243981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.244119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.244296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.244948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.245173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.245288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.245492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.245602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.245891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.246014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250453 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250600 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250691 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.250858 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251042 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.251947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252037 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252797 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.252966 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253157 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.253934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254360 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254434 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254504 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254886 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.254964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255437 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255917 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.255994 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256876 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.256971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257182 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.257898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258229 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.258839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.259960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.260196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.260859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.260964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.261165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.261508 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.261676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.261897 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.262890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263459 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263650 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.263964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264121 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264886 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.264996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.265993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.266250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.266354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.266559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.266659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.266873 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267805 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.267905 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.268996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269098 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.269914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.270871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271573 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.271926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272090 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.272816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273436 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.273945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.274058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.274904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.275916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276794 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.276894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277619 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.277926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278315 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278576 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.278912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279208 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.279819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280041 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.280973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.281990 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282333 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.282976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283286 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.283908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.284813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285055 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285154 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285472 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.285786 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286146 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.286970 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287685 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.287995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.288958 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.289955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290325 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.290920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.291122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.291259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.291469 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.291613 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.291909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292011 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292854 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.292955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293178 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.293908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294469 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294779 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.294881 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.295109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.295204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.295420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.295526 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.295677 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:18:31.295769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.296032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.296345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.296655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.296964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.297289 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.297614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.297920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.298271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.298591 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.298911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.299232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.299543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.299872 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.300182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.300500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.300812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.301124 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.301442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.301758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.302113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.303555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.303555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.303555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.303555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.304040 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.304040 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.304335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:18:31.304576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:18:31.318634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_db.sqlalchemy.engines [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.326954 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.396261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.context [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0f3d9c-730f-4da5-86cf-eb2d1921af52(cell1) {{(pid=116348) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:18:31.400660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:18:31.402915 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:18:31.403724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:18:31.405123 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.context [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0f3d9c-730f-4da5-86cf-eb2d1921af52(cell1) {{(pid=116349) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:18:31.405623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:18:31.409442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:18:31.411072 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:18:31.411880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:18:31.413790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:18:31.417128 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_db.sqlalchemy.engines [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.419389 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_db.sqlalchemy.engines [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.425641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.426713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.686010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:31.701451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_db.sqlalchemy.engines [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:18:32.014993 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: WARNING keystonemiddleware.auth_token [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:18:32.021711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: WARNING keystonemiddleware.auth_token [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:18:32.055404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: WARNING keystonemiddleware.auth_token [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:18:32.063024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: WARNING keystonemiddleware.auth_token [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:18:32.374084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: WARNING keystonemiddleware.auth_token [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:18:32.379406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: WARNING keystonemiddleware.auth_token [None req-c9aa46c6-7568-474d-9771-013e60e54149 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:18:32.384529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adc70e99c0 pid: 116349 (default app) Oct 27 01:18:32.432496 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: WARNING keystonemiddleware.auth_token [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:18:32.437921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: WARNING keystonemiddleware.auth_token [None req-b699aa47-695f-4bd3-88d4-c9988514f6fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:18:32.443089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adc70e99c0 pid: 116348 (default app) Oct 27 01:19:06.727108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f4adac61-c5fc-4f46-8572-c7849927071c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Action: 'create', calling method: .version_select at 0x7f1d381a1f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1717478649", "metadata": {"Type": "work"}}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:06.729094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f4adac61-c5fc-4f46-8572-c7849927071c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:06.730014 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f4adac61-c5fc-4f46-8572-c7849927071c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.462615 Oct 27 01:19:06.731062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:19:05 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1465 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:19:06.747633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-69c377bb-c120-4c59-8796-b8923b0e3f9c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Action: 'create', calling method: .version_select at 0x7f1d381c9af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588297780", "metadata": {"Type": "work"}}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:06.748917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-69c377bb-c120-4c59-8796-b8923b0e3f9c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:06.749899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-69c377bb-c120-4c59-8796-b8923b0e3f9c tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009298 Oct 27 01:19:06.751150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 2/2] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:19:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:19:06.762744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c501fba1-c6da-4cd9-b8d2-4f925825f637 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Action: 'create', calling method: .version_select at 0x7f1d381a18b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1747411857", "metadata": {"Type": "work"}}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:06.763867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c501fba1-c6da-4cd9-b8d2-4f925825f637 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:06.764639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c501fba1-c6da-4cd9-b8d2-4f925825f637 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006102 Oct 27 01:19:06.765146 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 3/3] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:19:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 01:19:06.778752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5d5d3b64-f2d8-42ba-bd9c-df6f89f65785 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Calling method '.version_select at 0x7f1d380e3af0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:07.232826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-92091d08-c58a-495d-8b01-41661a4196eb tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Action: 'create', calling method: .version_select at 0x7f1d381a1ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1987437246"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:07.620728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-5d5d3b64-f2d8-42ba-bd9c-df6f89f65785 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] HTTP exception thrown: Volume tempest-invalid-1732047290 could not be found. Oct 27 01:19:07.622168 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5d5d3b64-f2d8-42ba-bd9c-df6f89f65785 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 404 to user: Volume tempest-invalid-1732047290 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:07.623093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5d5d3b64-f2d8-42ba-bd9c-df6f89f65785 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1732047290" status: 404 len: 99 microversion: 2.1 time: 0.847997 Oct 27 01:19:07.624612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 4/4] 10.222.0.32 () {58 vars in 1217 bytes} [Wed Oct 27 01:19:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1732047290 => generated 99 bytes in 852 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 01:19:07.634958 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b39a99ff-8e08-48c4-b594-fae6cfeac47f tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004185 Oct 27 01:19:07.637476 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 5/5] 10.222.0.32 () {58 vars in 1139 bytes} [Wed Oct 27 01:19:07 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 01:19:07.650793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c98e9df6-30b9-4f3a-8066-83e3ff561a5d tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003834 Oct 27 01:19:07.651316 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 6/6] 10.222.0.32 () {58 vars in 1136 bytes} [Wed Oct 27 01:19:07 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 01:19:07.664021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-924c8dc9-f8e4-4224-b8d4-d0368a360f4b tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Calling method '.version_select at 0x7f1d38098040>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:07.971539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-924c8dc9-f8e4-4224-b8d4-d0368a360f4b tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] HTTP exception thrown: Volume 14219796-392f-4021-a71c-84019363aeab could not be found. Oct 27 01:19:07.972350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-924c8dc9-f8e4-4224-b8d4-d0368a360f4b tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 404 to user: Volume 14219796-392f-4021-a71c-84019363aeab could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:07.973347 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-924c8dc9-f8e4-4224-b8d4-d0368a360f4b tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/14219796-392f-4021-a71c-84019363aeab" status: 404 len: 109 microversion: 2.1 time: 0.317026 Oct 27 01:19:07.974236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 7/7] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:19:07 2021] DELETE /compute/v2.1/os-volumes/14219796-392f-4021-a71c-84019363aeab => generated 109 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:19:07.989932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-41418122-4515-45ba-912a-0baebc22a214 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Calling method '.version_select at 0x7f1d38086b80>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:08.879374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-41418122-4515-45ba-912a-0baebc22a214 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] HTTP exception thrown: Volume 077d2b9e-3456-427c-b2cf-28ea41bb9ddc could not be found. Oct 27 01:19:08.880010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-41418122-4515-45ba-912a-0baebc22a214 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] Returning 404 to user: Volume 077d2b9e-3456-427c-b2cf-28ea41bb9ddc could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:08.880829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-41418122-4515-45ba-912a-0baebc22a214 tempest-VolumesNegativeTest-231177966 tempest-VolumesNegativeTest-231177966-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/077d2b9e-3456-427c-b2cf-28ea41bb9ddc" status: 404 len: 109 microversion: 2.1 time: 0.901555 Oct 27 01:19:08.881363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 8/8] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:07 2021] GET /compute/v2.1/os-volumes/077d2b9e-3456-427c-b2cf-28ea41bb9ddc => generated 109 bytes in 903 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:19:09.421825 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1115982093", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "77bd38e7-6410-4eb5-a659-1d7bc09907ad"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:09.573941 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] validate_networks() for [('77bd38e7-6410-4eb5-a659-1d7bc09907ad', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:19:09.635749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-92091d08-c58a-495d-8b01-41661a4196eb tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.732239 Oct 27 01:19:09.649815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 1/9] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Oct 27 01:19:05 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3748 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 27 01:19:09.657496 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1211a261-0115-4ca8-b9ce-940a55530c04 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3807ca60>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:09.784183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1211a261-0115-4ca8-b9ce-940a55530c04 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 0.132970 Oct 27 01:19:09.784748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 2/10] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:09 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:10.797112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-67e62747-7256-4379-aff1-de61e6028f37 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3807cf70>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:10.846316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-67e62747-7256-4379-aff1-de61e6028f37 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 346 microversion: 2.1 time: 0.053296 Oct 27 01:19:10.847163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 3/11] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:10 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:10.863912 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6c9b420c-4dca-4220-b00b-a0156165b23e tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Action: 'create', calling method: .version_select at 0x7f1d38090430>, body: {"snapshot": {"volume_id": "0cdfa375-139a-4ecb-8ba7-b2dde4b8c179", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-35085236"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:10.994343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:19:10.994343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:19:10.994343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:19:10.994343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:19:10.994343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:19:11.034397 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:11.034944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:11.035620 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:11.036051 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:11.120554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Getting quotas for project 341b274900784c5f8f6e3b7f10f80cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:11.129497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Getting quotas for user b11b35bf64df44739ab333b4f130d23a and project 341b274900784c5f8f6e3b7f10f80cc8. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:11.148279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:19:11.150211 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:19:11.514126 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-313f269e-867f-4175-b0ed-16e887bcc1f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249389 Oct 27 01:19:11.520618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 9/12] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:19:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:19:11.534003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9547f567-5319-4f24-980f-ee152625e11d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:11.541554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9547f567-5319-4f24-980f-ee152625e11d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:11.652785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9547f567-5319-4f24-980f-ee152625e11d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:11.670312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9547f567-5319-4f24-980f-ee152625e11d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1215 microversion: 2.1 time: 0.148032 Oct 27 01:19:11.683840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 10/13] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:11 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:11.694214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6c9b420c-4dca-4220-b00b-a0156165b23e tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.837208 Oct 27 01:19:11.695320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 4/14] 10.222.0.32 () {60 vars in 1161 bytes} [Wed Oct 27 01:19:10 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:11.711926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0e690b13-8c8e-4288-9e7e-4ae9af189f89 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d37f97af0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:11.829885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0e690b13-8c8e-4288-9e7e-4ae9af189f89 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.126853 Oct 27 01:19:11.830241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 11/15] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:11 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:11.839947 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-92b75c6d-26b6-4749-abb3-9bd697c48f5d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d38090f70>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:11.927669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-92b75c6d-26b6-4749-abb3-9bd697c48f5d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.092269 Oct 27 01:19:11.928394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 5/16] 10.222.0.32 () {58 vars in 1139 bytes} [Wed Oct 27 01:19:11 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:11.940231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-838e8a36-ba6a-44eb-aacd-4499cf05aecd tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f4be50>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:12.030696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-838e8a36-ba6a-44eb-aacd-4499cf05aecd tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.094738 Oct 27 01:19:12.032353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 12/17] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:11 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:12.691414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b0adb4a1-2f75-40e2-a9bb-76aa5ea2ccc0 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:12.692142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b0adb4a1-2f75-40e2-a9bb-76aa5ea2ccc0 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:12.932930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b0adb4a1-2f75-40e2-a9bb-76aa5ea2ccc0 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:13.011185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b0adb4a1-2f75-40e2-a9bb-76aa5ea2ccc0 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1215 microversion: 2.1 time: 0.319282 Oct 27 01:19:13.017221 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 6/18] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:12 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:13.044644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-79f9c1cc-dcdf-41b0-92e9-74eb4e68c523 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f5a790>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:13.114705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-79f9c1cc-dcdf-41b0-92e9-74eb4e68c523 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.075186 Oct 27 01:19:13.115268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 13/19] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:13 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:14.028972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3b2245c8-3964-43e3-b65e-20280e036e1d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:14.030250 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3b2245c8-3964-43e3-b65e-20280e036e1d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:14.127337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bcb723b4-42a9-4ff7-b795-bdf422733bcd tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f5adc0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:14.213263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bcb723b4-42a9-4ff7-b795-bdf422733bcd tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.089572 Oct 27 01:19:14.213831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 14/20] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:14 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:14.316518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3b2245c8-3964-43e3-b65e-20280e036e1d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:14.328380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3b2245c8-3964-43e3-b65e-20280e036e1d tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1215 microversion: 2.1 time: 0.307790 Oct 27 01:19:14.329603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 7/21] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:14 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:15.234744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1fc2ee11-eeab-483f-b597-a5aa8c6054e1 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f5a4c0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:15.312898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1fc2ee11-eeab-483f-b597-a5aa8c6054e1 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.090199 Oct 27 01:19:15.326614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 15/22] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:15 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:15.346417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:15.347021 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:15.356604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:15.357047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:15.357814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:15.358268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:15.744687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:15.763333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e1a8f6a3-5b06-448e-a2b8-0cc1ab81b156 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1219 microversion: 2.1 time: 0.420542 Oct 27 01:19:15.768420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 8/23] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:15 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1219 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:16.333817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fcd888b9-279e-4fa1-892e-558e2f6c89e0 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f4b550>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:16.482744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fcd888b9-279e-4fa1-892e-558e2f6c89e0 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.152397 Oct 27 01:19:16.486811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 16/24] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:16 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:16.787411 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:16.788052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:16.816283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:16.816283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:16.816501 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:16.816892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:17.035724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:17.048216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3287f939-8739-4b52-be4f-f8de16faeb55 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1211 microversion: 2.1 time: 0.269844 Oct 27 01:19:17.060721 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 9/25] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:16 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1211 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:17.498917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8bd2588e-fa74-42a3-ae27-ba81f5270656 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36f33af0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:17.577650 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8bd2588e-fa74-42a3-ae27-ba81f5270656 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.081323 Oct 27 01:19:17.579083 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 17/26] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:17 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:18.074008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:18.074738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:18.094376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:18.094376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:18.094376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:18.102220 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:18.272200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:18.291355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-14d0adda-d826-4f4f-b712-8c397c68f1ce tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1211 microversion: 2.1 time: 0.223624 Oct 27 01:19:18.291355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 10/27] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:18 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1211 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:18.594313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2edf1ccc-5136-4d52-9fed-3721aebb3399 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d37f7ab80>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:18.652979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: .version_select at 0x7f1d3802af70>, body: {"keypair": {"name": "tempest-keypair-316864813"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:18.686401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2edf1ccc-5136-4d52-9fed-3721aebb3399 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.102515 Oct 27 01:19:18.691217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 11/28] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:18 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:18.740745 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:18.767170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:19.003829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-315383076", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1517e22-2395-4c57-bae6-bd47c809e7b9"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:19.037428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:19.044951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:19.095751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-587ef1d2-e535-41a6-ad19-6f19ada5b35e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.748844 Oct 27 01:19:19.097025 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 18/29] 10.222.0.32 () {62 vars in 1198 bytes} [Wed Oct 27 01:19:18 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 751 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:19:19.172956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] validate_networks() for [('e1517e22-2395-4c57-bae6-bd47c809e7b9', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:19:19.307113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:19.308033 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:19.319720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:19.323602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:19.326661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:19.326661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:19.756184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:19.756184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7af33db4-597b-4e5c-89e7-43f88c9f98d9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1267 microversion: 2.1 time: 0.307100 Oct 27 01:19:19.756184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 19/30] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:19 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:19.756184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-226d208e-f8a0-4727-82ab-a71104e40a00 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d366213a0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:19.762000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-226d208e-f8a0-4727-82ab-a71104e40a00 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 286 microversion: 2.1 time: 0.055758 Oct 27 01:19:19.762000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 20/31] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:19 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:19.768293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cefa6409-6c9d-462a-b8fa-c1a8bdba0e0d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3667b670>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:19.947202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cefa6409-6c9d-462a-b8fa-c1a8bdba0e0d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 202 len: 0 microversion: 2.1 time: 0.178204 Oct 27 01:19:19.947202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 21/32] 10.222.0.32 () {58 vars in 1253 bytes} [Wed Oct 27 01:19:19 2021] DELETE /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:19:19.956528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d5834862-0f8e-4579-96da-d92d82f029fb tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3662e9d0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:20.010157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d5834862-0f8e-4579-96da-d92d82f029fb tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.059404 Oct 27 01:19:20.011035 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 22/33] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:19 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:20.165603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: .version_select at 0x7f1d3662e940>, body: {"keypair": {"name": "tempest-keypair-1451479014"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:20.192560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:20.197734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:20.399054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:19:20.399548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:19:20.400107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:19:20.400612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:19:20.401103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:19:20.447740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:20.448262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:20.449240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:20.449751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:20.492564 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Getting quotas for project 7ac535690bf24eb9bbf7d42426b21c74. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:20.508793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Getting quotas for user 1ac05d2fe5fa40b4a18063d0d335d9e2 and project 7ac535690bf24eb9bbf7d42426b21c74. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:20.536804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:19:20.544529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:19:20.993840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:21.004159 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:21.026810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b3c62766-181d-4bc3-a1b2-2b4a601b8c91 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.014608 Oct 27 01:19:21.028275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 23/34] 10.222.0.32 () {60 vars in 1157 bytes} [Wed Oct 27 01:19:20 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:21.042458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:21.042689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4be621a2-f52c-4f2d-aa08-f9fa7e56231f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.207342 Oct 27 01:19:21.043141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:21.046317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 12/35] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:19:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:19:21.048808 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-43341426-e3ec-429b-b708-022e5105716d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d37670670>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:21.054617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:21.054617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:21.054617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:21.054617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:21.106075 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-43341426-e3ec-429b-b708-022e5105716d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.061022 Oct 27 01:19:21.106922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 13/36] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:21 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:21.113193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-39e6eef4-6281-4453-9907-3f8eacb607fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:21.117716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-39e6eef4-6281-4453-9907-3f8eacb607fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:21.141334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:21.155695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-65cf893a-5448-4116-abc4-017d05a18c7e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1267 microversion: 2.1 time: 0.120646 Oct 27 01:19:21.156990 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 24/37] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:21 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:21.213391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39e6eef4-6281-4453-9907-3f8eacb607fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:21.220459 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-39e6eef4-6281-4453-9907-3f8eacb607fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1221 microversion: 2.1 time: 0.112477 Oct 27 01:19:21.222056 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 14/38] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:21 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:21.421716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-582914438", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1517e22-2395-4c57-bae6-bd47c809e7b9"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:21.491087 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] validate_networks() for [('e1517e22-2395-4c57-bae6-bd47c809e7b9', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:19:22.119587 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a227638f-b243-474e-bff4-18fa5b7b529d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d37fccca0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:22.233744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a227638f-b243-474e-bff4-18fa5b7b529d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 200 len: 285 microversion: 2.1 time: 0.119285 Oct 27 01:19:22.234533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 15/39] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:22 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:22.244143 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:22.245631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:22.279065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:22.279065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:22.279065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:22.279065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:22.369228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:19:22.369718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:19:22.370136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:19:22.370605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:19:22.371028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:19:22.383388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:22.383832 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:22.384629 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:22.388484 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:22.448758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Getting quotas for project 7ac535690bf24eb9bbf7d42426b21c74. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:22.462523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Getting quotas for user 1ac05d2fe5fa40b4a18063d0d335d9e2 and project 7ac535690bf24eb9bbf7d42426b21c74. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:22.522426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:19:22.541137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:19:22.631085 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:22.654373 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-58e413e8-ba94-4e89-85e1-c67401d6fb74 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1275 microversion: 2.1 time: 0.414291 Oct 27 01:19:22.678095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 16/40] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:22 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1275 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:22.775585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4d6913b6-ab95-49a9-80b4-94be4eb4d076 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.359132 Oct 27 01:19:22.779873 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 25/41] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:19:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:19:22.803115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d233f65-0c8e-41fb-919f-6c6498003baf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:22.807127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9d233f65-0c8e-41fb-919f-6c6498003baf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:23.248220 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-631ddb8a-bc6e-4f58-837c-0987b8cfb8b6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3667b5e0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:23.318808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-631ddb8a-bc6e-4f58-837c-0987b8cfb8b6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] HTTP exception thrown: Snapshot cd099a8d-70ff-4605-aa83-c3eddd8f8f6e could not be found. Oct 27 01:19:23.319579 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-631ddb8a-bc6e-4f58-837c-0987b8cfb8b6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Returning 404 to user: Snapshot cd099a8d-70ff-4605-aa83-c3eddd8f8f6e could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:23.321342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-631ddb8a-bc6e-4f58-837c-0987b8cfb8b6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e" status: 404 len: 111 microversion: 2.1 time: 0.079259 Oct 27 01:19:23.322239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 26/42] 10.222.0.32 () {58 vars in 1250 bytes} [Wed Oct 27 01:19:23 2021] GET /compute/v2.1/os-snapshots/cd099a8d-70ff-4605-aa83-c3eddd8f8f6e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:19:23.331650 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5e6ad36e-d257-4e1e-af4e-4177e3ee8199 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3667baf0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:23.556652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9d233f65-0c8e-41fb-919f-6c6498003baf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:23.564966 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9d233f65-0c8e-41fb-919f-6c6498003baf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1221 microversion: 2.1 time: 0.778096 Oct 27 01:19:23.573222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 17/43] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:22 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1221 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:23.657884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5e6ad36e-d257-4e1e-af4e-4177e3ee8199 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 202 len: 0 microversion: 2.1 time: 0.330247 Oct 27 01:19:23.660239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 27/44] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:19:23 2021] DELETE /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:19:23.672748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ec018ed5-8cbb-474d-8d3f-8ebfcd7e42f4 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3769a670>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:23.699742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:23.699742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:23.712811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:23.716291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:23.718766 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:23.720711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:23.785589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ec018ed5-8cbb-474d-8d3f-8ebfcd7e42f4 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 0.120741 Oct 27 01:19:23.790903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 18/45] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:23 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:23.875687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:23.890546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-429f12d8-ecf2-48b9-a389-26f8f2840373 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1273 microversion: 2.1 time: 0.197745 Oct 27 01:19:23.890546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 28/46] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:23 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:24.582923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:24.583589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:24.599813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:24.600299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:24.602844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:24.606591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:24.800775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-02532637-6fe6-4364-8d60-8b047c93473c tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3662ef70>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:24.903288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:24.915630 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f65afc66-998a-4546-bef3-c8f6f8871f49 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.335112 Oct 27 01:19:24.927464 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 19/47] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:24 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:24.937876 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:24.940209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:24.954324 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:24.954673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:24.955771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:24.956524 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:25.282249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:25.290872 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9adb6f9b-98bc-4881-95cc-9d63cddc921a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.360488 Oct 27 01:19:25.292038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 20/48] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:24 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:25.588015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1140065715", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "337a2dfd-96cd-45e0-abce-401982e807e4"}], "security_groups": [{"name": "tempest-securitygroup--1527755121"}], "key_name": "tempest-keypair-316864813", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:25.780335 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] validate_networks() for [('337a2dfd-96cd-45e0-abce-401982e807e4', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:19:25.863884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-02532637-6fe6-4364-8d60-8b047c93473c tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 1.068077 Oct 27 01:19:25.864734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 29/49] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:24 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:25.934378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:25.934750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:25.943931 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:25.944376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:25.953190 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:25.961666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:26.085236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:26.094826 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dae4101e-c623-4235-bc7e-a8bfcfac8ee7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.164412 Oct 27 01:19:26.110229 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 30/50] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:25 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:26.309388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:26.310396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:26.327086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:26.328588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:26.329862 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:26.330562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:26.665629 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:19:26.666804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:19:26.668847 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:19:26.670314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:19:26.670954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:19:26.733829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:26.744130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:26.744130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:26.744130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:26.744130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:26.744682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-994e4ba9-0ff2-4d3b-987a-bb703726baf4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.438206 Oct 27 01:19:26.744682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 31/51] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:26 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:26.749629 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1092876129", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5b7050d-f17d-40a3-83d0-485beb1349f9"}], "security_groups": [{"name": "tempest-securitygroup--1613836754"}], "key_name": "tempest-keypair-1451479014", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:26.779394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:26.801813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:26.824086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:19:26.836289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:19:26.910837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] validate_networks() for [('b5b7050d-f17d-40a3-83d0-485beb1349f9', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:19:27.050664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c4376b83-d8ad-49a1-b560-4b94a200c68f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.462153 Oct 27 01:19:27.051709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 21/52] 10.222.0.32 () {62 vars in 1187 bytes} [Wed Oct 27 01:19:25 2021] POST /compute/v2.1/servers => generated 402 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 01:19:27.074702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-22abce24-2f88-4bc5-a90c-e5e093278f3d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d36e22f70>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:27.168172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-22abce24-2f88-4bc5-a90c-e5e093278f3d tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 0.114898 Oct 27 01:19:27.173536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 22/53] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:27 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:27.184848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:27.185739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:27.263059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:27.274249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:27.283180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:27.285522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-53f74c9a-6bc7-4929-885c-a08a6962fe30 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1281 microversion: 2.20 time: 0.109250 Oct 27 01:19:27.287024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 23/54] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:27 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:27.300419 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:27.301262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:27.312322 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.315921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.315921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.315921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.439210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:27.468310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-af6dbb0a-242c-4cf4-a028-5abdd65a0a18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.181345 Oct 27 01:19:27.472606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 24/55] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:27 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:27.765289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:27.771469 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:27.774688 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:19:27.775314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:19:27.775967 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:19:27.776446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:19:27.776975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:19:27.787782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.788151 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.789497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.789935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.797640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.798917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.800371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:27.801008 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:27.835527 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:19:27.859080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:19:27.876719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:19:27.879231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:19:27.963566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:27.973721 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-45ea9866-c84a-40d8-8fa0-4814c4bcdb64 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.214064 Oct 27 01:19:27.974731 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 25/56] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:27 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:28.180735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-45d749bd-815b-4a5a-94d3-3c46cd159257 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d37695160>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:28.294931 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6a1dc352-ac8a-4633-8c42-6ec2b00d35d5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.550393 Oct 27 01:19:28.303233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 32/57] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:19:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:19:28.309093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:28.310916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:28.400934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:28.411868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:28.414135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:28.415539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-080a4004-a3c8-4d60-a103-4cfd967ee728 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1281 microversion: 2.20 time: 0.110952 Oct 27 01:19:28.416606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 33/58] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:28 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:28.421842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a9b0b543-08fb-4cec-9ccf-d104d165942f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:28.422671 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a9b0b543-08fb-4cec-9ccf-d104d165942f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:28.500357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a9b0b543-08fb-4cec-9ccf-d104d165942f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:28.509845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a9b0b543-08fb-4cec-9ccf-d104d165942f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1238 microversion: 2.1 time: 0.091322 Oct 27 01:19:28.510775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 34/59] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:28 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:28.524735 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:28.525604 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:28.533238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:28.535918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:28.535918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:28.537148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:28.568636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-45d749bd-815b-4a5a-94d3-3c46cd159257 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 0.391661 Oct 27 01:19:28.569559 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 26/60] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:28 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:28.623544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:28.641419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5bc61f15-8f02-4605-9e6d-3206cc4a1fad tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.113830 Oct 27 01:19:28.642446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 35/61] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:28 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:28.991816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:28.992428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:29.000575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:29.001028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:29.001803 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:29.002343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:29.197723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.205830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16754437-2cb2-442b-b880-fb9b9b95e02c tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.217618 Oct 27 01:19:29.206546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 27/62] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:28 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:29.433960 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:29.434624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:29.487587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.494901 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.496454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.497574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-19f6635b-04e6-4b62-9250-95b98fa1ad5e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1281 microversion: 2.20 time: 0.067424 Oct 27 01:19:29.498158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 36/63] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:29 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:29.529507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3d202a2b-edf1-413e-bdd3-23f4f7f244b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:29.529696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3d202a2b-edf1-413e-bdd3-23f4f7f244b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:29.581971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6d8d02c4-5b72-43b3-af6f-17e784fc074f tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3662ef70>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:29.615771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3d202a2b-edf1-413e-bdd3-23f4f7f244b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.624378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3d202a2b-edf1-413e-bdd3-23f4f7f244b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1238 microversion: 2.1 time: 0.099859 Oct 27 01:19:29.627295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 28/64] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:29 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:29.649263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:29.654818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:29.682717 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6d8d02c4-5b72-43b3-af6f-17e784fc074f tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 200 len: 345 microversion: 2.1 time: 0.104425 Oct 27 01:19:29.683304 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 37/65] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:29 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:29.691465 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:29.691916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:29.696362 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:29.697218 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:29.788159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:29.796634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-21d540a7-ff01-4d25-ab36-eacb7fcaa39f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.151532 Oct 27 01:19:29.797423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 29/66] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:29 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:30.223685 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.224215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:30.232860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.233409 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.234380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.235224 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.366379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.373851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-20839873-2d1b-4f2e-89eb-030c3d662f3b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.154018 Oct 27 01:19:30.374555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 38/67] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:30.517113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.517765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:30.525890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.526475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.527385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.527830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.608437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.619309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.620903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.622368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9caf7b99-bedf-4380-8539-c831adf9c11a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.109470 Oct 27 01:19:30.626073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 30/68] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:30.642829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.643438 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:30.649419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.649858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.650639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.651075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.709207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f9d4c669-2738-4568-9744-a40f4b348463 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d376959d0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.730574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.746092 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-038445be-2e8a-40cd-81be-bb1c78c11d9b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.104991 Oct 27 01:19:30.748086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 39/69] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:30.761880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-f9d4c669-2738-4568-9744-a40f4b348463 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] HTTP exception thrown: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. Oct 27 01:19:30.761880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f9d4c669-2738-4568-9744-a40f4b348463 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Returning 404 to user: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:30.761880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f9d4c669-2738-4568-9744-a40f4b348463 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 404 len: 109 microversion: 2.1 time: 0.050684 Oct 27 01:19:30.761880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 31/70] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:19:30.772747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5ca91d23-2466-4740-9f12-ccb89009eff6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3663d040>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.811407 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-5ca91d23-2466-4740-9f12-ccb89009eff6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] HTTP exception thrown: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. Oct 27 01:19:30.812284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5ca91d23-2466-4740-9f12-ccb89009eff6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Returning 404 to user: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:30.815109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5ca91d23-2466-4740-9f12-ccb89009eff6 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 404 len: 109 microversion: 2.1 time: 0.046366 Oct 27 01:19:30.820653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 40/71] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:19:30 2021] DELETE /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:19:30.820786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.820786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:30.827118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3ea52e09-fd94-4bdb-9db7-967d1520a5b7 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Calling method '.version_select at 0x7f1d3662e8b0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:30.827314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.827866 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.828796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:30.829374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:30.873352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-3ea52e09-fd94-4bdb-9db7-967d1520a5b7 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] HTTP exception thrown: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. Oct 27 01:19:30.873352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3ea52e09-fd94-4bdb-9db7-967d1520a5b7 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] Returning 404 to user: Volume 0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:19:30.873352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3ea52e09-fd94-4bdb-9db7-967d1520a5b7 tempest-VolumesSnapshotsTestJSON-1547593781 tempest-VolumesSnapshotsTestJSON-1547593781-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179" status: 404 len: 109 microversion: 2.1 time: 0.041099 Oct 27 01:19:30.873352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 41/72] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/os-volumes/0cdfa375-139a-4ecb-8ba7-b2dde4b8c179 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:19:30.908766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:30.918929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-87904b3b-2c53-46bc-a281-980487a77c64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.105128 Oct 27 01:19:30.919710 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 32/73] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:30 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:31.392200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:31.393240 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:31.400402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.401323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.402320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.407986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.641825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:31.642560 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:31.661899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.662377 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.663262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.663794 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.678378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:31.686713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8b31d1f4-066d-4b82-a211-462fb01c4e99 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.298093 Oct 27 01:19:31.687302 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 42/74] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:31 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:31.764080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:31.764697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:31.765222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:31.777073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.777898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.779739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.781004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.791834 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:31.796999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:31.798505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-10280bb8-b30e-4e65-b3a2-6e703137d56b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.161025 Oct 27 01:19:31.812764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 33/75] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:31 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:19:31.876577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:31.885069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e2bde458-c707-4f69-80d0-7ed50e2d2ec0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.125521 Oct 27 01:19:31.886154 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 43/76] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:31 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:31.936788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:31.937399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:31.948207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.948652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:31.949442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:31.949878 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:32.032875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:32.042534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-aedd441d-b478-4b8f-aa4d-d1c89ea25cc9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.108550 Oct 27 01:19:32.043011 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 34/77] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:31 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:32.704322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:32.704962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:32.715960 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:32.716565 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:32.717351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:32.718059 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:32.817008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:32.819369 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:32.824104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:32.824774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:32.825723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:32.826566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:33.024095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.024095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.024292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.024292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-58300db9-5be2-48ff-9e87-154cb8b84ebb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.116338 Oct 27 01:19:33.024292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 35/78] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:32 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:33.024292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:33.024549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:33.024549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:33.024549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:33.024549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:33.024831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:33.024898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.024898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a3e66697-052f-4737-a38f-7c63ab3b5745 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.272423 Oct 27 01:19:33.024898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 44/79] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:32 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:33.029244 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.042646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c7c23f2e-9a4d-459f-bac8-d288db029804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.106239 Oct 27 01:19:33.042646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 36/80] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:32 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:33.059074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:33.059713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:33.066458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:33.066904 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:33.068252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:33.068700 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:33.134373 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:33.141563 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5d4eb37c-a8a2-46f2-aa01-9a28e4c10830 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.086424 Oct 27 01:19:33.142137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 45/81] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:33 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:34.061311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:34.061897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:34.062775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:34.063601 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:34.068694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.069223 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.069760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.070217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.070386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.070791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.071188 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.071622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.148571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.161075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-48233168-d873-4cb2-a55b-9eac1977aaf7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.101941 Oct 27 01:19:34.171502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 46/82] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:34 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:34.187260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:34.187868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:34.193889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.194324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.206350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.206350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.317205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.318639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.328420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-345fd945-e91e-4669-a8b3-3fb06c17c4a9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.270800 Oct 27 01:19:34.330602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.332107 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.334776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-72659abe-2dc0-4f73-9446-91aa055b47fa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.171834 Oct 27 01:19:34.346781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 47/83] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:34 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:34.346781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:34.346781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:34.358112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 37/84] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:34 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:34.360979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.360979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.360979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:34.360979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:34.422987 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:34.430996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-555ee3b4-8c4a-4669-9a90-671174f7c2e9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.093053 Oct 27 01:19:34.431575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 48/85] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:34 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:35.180653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:35.181376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:35.187816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.188453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.189252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.189675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.261229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.268800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ecb6d683-5230-40bd-a3e6-8e11e8faf3b2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.093636 Oct 27 01:19:35.269411 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 38/86] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:35 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:35.354152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:35.354731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:35.360803 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.362240 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.362240 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.362488 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.369352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:35.369997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:35.376615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.377087 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.378086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.378460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.461455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.471443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.473356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.475087 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ee49e1de-a1e1-4893-bfa6-4715a80fd08e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.124674 Oct 27 01:19:35.476668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 49/87] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:35 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:35.481545 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:35.482436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:35.499321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.499321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.499321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:35.499321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:35.606130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.613929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5f3c2759-45f1-483a-b3d1-abe1a90f902f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.136019 Oct 27 01:19:35.614709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 50/88] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:35 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:35.628724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:35.644312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-39e7a614-f8c6-4fde-b0b1-fde79f139a1a tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.280299 Oct 27 01:19:35.651540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 39/89] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:35 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:36.287449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:36.288077 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:36.295322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.295752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.302670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.303340 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.383238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.390822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-628d49b1-f9c2-4387-9eaf-ee934d5dc232 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.107038 Oct 27 01:19:36.391397 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 51/90] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:36 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:36.496207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:36.496836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:36.503349 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.504023 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.504777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.505203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.569174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.578314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.579983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.581225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-58144a1f-d1c8-4f62-bef9-06f9fbe27cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.088843 Oct 27 01:19:36.590590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 40/91] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:36 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:36.631720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:36.633430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:36.640721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.641423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.642445 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.643100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.666429 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:36.667309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:36.673435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.673884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.674680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:36.675100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:36.707138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.712757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-00bd71fc-986c-4422-b1d9-dd7cc5512e68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.085393 Oct 27 01:19:36.713738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 52/92] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:36 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:36.823041 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:36.830186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fb37a61f-d015-4789-ab87-b3c73f092828 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.167411 Oct 27 01:19:36.830742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 41/93] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:36 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:37.408932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:37.409564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:37.415413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.415856 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.416730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.417055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.482000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:37.490048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-41e3955f-71f9-4277-b9df-fc16f9d745fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1242 microversion: 2.1 time: 0.085238 Oct 27 01:19:37.490694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 53/94] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:37 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:37.600317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:37.607823 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:37.608974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.609681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.610473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.610910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.684016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:37.697809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:37.701433 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:37.703118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2db579b9-e92f-4906-adfe-4d370d6e5380 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1285 microversion: 2.20 time: 0.106506 Oct 27 01:19:37.703829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 42/95] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:37 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:37.732554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:37.734151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:37.744860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.745563 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.746673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.748136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.822933 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:37.837678 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2f8b0045-fc7f-4fb4-b5bd-4000acc69b78 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1225 microversion: 2.1 time: 0.109647 Oct 27 01:19:37.838606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 54/96] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:37 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:37.846668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:37.847655 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:37.855889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.856474 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:37.857127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:37.857530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.026072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.036432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-95b00f27-9bbe-4fdd-84cf-b8d36b4d7a61 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.193451 Oct 27 01:19:38.039460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 43/97] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:37 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:38.507705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:38.508312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:38.515845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.516288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.521134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.521134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.595920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.616589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-eb6a170a-fe47-4f2a-8101-c6c65f7fc79d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1234 microversion: 2.1 time: 0.101387 Oct 27 01:19:38.616589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 55/98] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:38 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:38.721581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:38.722226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:38.728150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.728596 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.729356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.729783 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.813028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.822996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.829714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.829714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-93f6cf03-c3c5-4ba3-af7d-8d9e2fc1158e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1333 microversion: 2.20 time: 0.107885 Oct 27 01:19:38.829714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 44/99] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:38 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:38.854523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:38.855421 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:38.864007 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.866814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.868745 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:38.869187 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:38.968514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:38.973665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-58a9ae81-a291-40ba-8b28-9dc0a320c915 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1217 microversion: 2.1 time: 0.122858 Oct 27 01:19:38.974972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 56/100] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:38 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:39.053255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-add90773-f72e-4201-b0cd-9052c3a326a9 req-695316eb-a98b-4588-965a-5491155a54e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb", "tag": "d57d358b-f7a1-474b-ac04-7171ac14de0f"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:39.054090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:39.060530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:39.060662 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:39.060662 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:19:39.062250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.062705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.063539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.063977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.097415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-add90773-f72e-4201-b0cd-9052c3a326a9 req-695316eb-a98b-4588-965a-5491155a54e6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.101167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-add90773-f72e-4201-b0cd-9052c3a326a9 req-695316eb-a98b-4588-965a-5491155a54e6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.160270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-add90773-f72e-4201-b0cd-9052c3a326a9 req-695316eb-a98b-4588-965a-5491155a54e6 service nova] Creating event network-changed:d57d358b-f7a1-474b-ac04-7171ac14de0f for instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb on hv-cinder-81556 Oct 27 01:19:39.160813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-add90773-f72e-4201-b0cd-9052c3a326a9 req-695316eb-a98b-4588-965a-5491155a54e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116348) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 01:19:39.164860 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.165313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.166151 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.177786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.210174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.compute.rpcapi [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 01:19:39.211715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] Releasing lock "compute-rpcapi-router" {{(pid=116348) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 01:19:39.263723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cbd70ea6-dd43-43ba-83a9-f16faf990584 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315409 Oct 27 01:19:39.275906 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 45/101] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:39.290729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:39.309185 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5d182e88-766e-41b9-bcb4-287a0c89166f tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.259230 Oct 27 01:19:39.320399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 57/102] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:39 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:39.642357 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:39.644999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:39.674702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.675073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.676131 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.677380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.775254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:39.783977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4c75a302-45c2-4393-bc9f-7897e9a49f6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1234 microversion: 2.1 time: 0.155416 Oct 27 01:19:39.784604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 46/103] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:39 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1234 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:39.847722 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:39.848583 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:39.857577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.858173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.861618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:39.862294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:39.993823 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:39.994693 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:40.000680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.001483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.002513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.003142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.059649 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.073048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.077325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.082242 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c2526499-a531-44b4-9473-a489e6468b9a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1351 microversion: 2.20 time: 0.234465 Oct 27 01:19:40.083159 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 58/104] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:39 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:40.291198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.312548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-78076f8d-b8d2-4b16-9ef2-94f3ec42e92b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1273 microversion: 2.1 time: 0.325451 Oct 27 01:19:40.332505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:40.334271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:40.339612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 47/105] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:39 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:40.343790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.345177 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.347430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.348760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.616946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.627978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e5c0457e-bd03-45c2-aa6d-96d05ee35389 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.303801 Oct 27 01:19:40.631422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 59/106] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:40 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:40.804156 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:40.806017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:40.819741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.819741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.819741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:40.819741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:40.900180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:40.906585 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fa88dbf4-4a9f-4828-b4a3-522359724986 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1290 microversion: 2.1 time: 0.107397 Oct 27 01:19:40.908606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 48/107] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:40 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:41.105307 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:41.106631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:41.119032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.119680 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.126890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.126890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.339678 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:41.354566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:41.368608 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:41.386202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:41.401593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:41.403133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.403768 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.405809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2c757aa8-fc55-4903-b1a4-78754640a6c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.304277 Oct 27 01:19:41.407267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.409570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.414486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 60/108] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:41 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:41.515082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:41.524209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3442edfe-5eda-4c94-b008-a1182fbaaf1c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1279 microversion: 2.1 time: 0.174606 Oct 27 01:19:41.525421 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 49/109] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:41 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:41.649354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:41.650088 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:41.657598 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.658167 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.659135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.659855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.784180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:41.796448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3f5d053e-b63d-41d3-b97c-726d09940729 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.152881 Oct 27 01:19:41.798462 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 61/110] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:41 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:41.924546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:41.925889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:41.933828 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.934605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:41.935618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:41.936234 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.005539 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.013750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9a096507-2f97-4b9c-aa1d-95a0757a69a0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1298 microversion: 2.1 time: 0.092844 Oct 27 01:19:42.024113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 50/111] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:41 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:42.219575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-3640a1a5-a54b-4830-b581-6d953bbdcf43 req-39e0ed37-de10-4aa1-bfec-6cbc79a6e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c00af12-ba9b-4253-8e58-985becdb2ad0", "tag": "4f1eccc2-4d63-4101-be4a-ce4e532f88e2"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:42.221793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:42.221793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:42.243320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-3640a1a5-a54b-4830-b581-6d953bbdcf43 req-39e0ed37-de10-4aa1-bfec-6cbc79a6e6a4 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.243320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-3640a1a5-a54b-4830-b581-6d953bbdcf43 req-39e0ed37-de10-4aa1-bfec-6cbc79a6e6a4 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.269044 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-3640a1a5-a54b-4830-b581-6d953bbdcf43 req-39e0ed37-de10-4aa1-bfec-6cbc79a6e6a4 service nova] Creating event network-changed:4f1eccc2-4d63-4101-be4a-ce4e532f88e2 for instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 on hv-cinder-81556 Oct 27 01:19:42.269570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-3640a1a5-a54b-4830-b581-6d953bbdcf43 req-39e0ed37-de10-4aa1-bfec-6cbc79a6e6a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 01:19:42.270703 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.271779 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.272880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.273303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.282414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.compute.rpcapi [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 01:19:42.283219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] Releasing lock "compute-rpcapi-router" {{(pid=116349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 01:19:42.317291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-211a3946-d848-4f99-bc32-ede8de64a347 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100858 Oct 27 01:19:42.318861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 62/112] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:42.427955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:42.428547 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:42.434898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.435341 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.436106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.436531 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.544158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:42.544891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:42.551592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.557019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.557019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.557019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.643542 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.654941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.657327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.658623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-688ad421-4b21-41a3-9dc0-d655ba287092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.234328 Oct 27 01:19:42.659705 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 51/113] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:42 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:42.712566 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.719865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-314c4a6d-e415-4911-aa76-bb986019574d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.180602 Oct 27 01:19:42.720430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 63/114] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:42 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:42.813964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:42.814723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:42.822374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.822890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.823658 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:42.824284 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:42.952240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:42.959520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6862320d-a9ce-4222-8abc-b0829727b2b3 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.149406 Oct 27 01:19:42.960765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 52/115] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:42 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:43.031526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:43.032223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:43.038269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.038761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.039454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.039880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.108657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:43.116225 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c4da2cb7-3778-44af-b5a8-721ca823578c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1298 microversion: 2.1 time: 0.088175 Oct 27 01:19:43.116937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 64/116] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:43 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:43.676982 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:43.677803 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:43.683560 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.684000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.684759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.685186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.736734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:43.737424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:43.743712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.746622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.750768 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.750768 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.845602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:43.855137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:43.856633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:43.857733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1cf0bf96-137e-4192-9f68-78139b102ffd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.184655 Oct 27 01:19:43.858355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 53/117] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:43 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:43.914907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:43.922355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-875d3b3d-685d-4477-a33d-5b0371320590 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.189469 Oct 27 01:19:43.922865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 65/118] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:43 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:43.976812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:43.977502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:43.983708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.984639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:43.985407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:43.985989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.128655 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:44.135037 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:44.138503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:44.138620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4a7d991b-4480-4bde-8f5b-c9a7a62abcb9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.164111 Oct 27 01:19:44.138620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 54/119] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:43 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:44.142785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.143236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.144015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.144500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.242638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:44.266458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-90cb2aa8-fdd2-4dc3-82f7-682943704e03 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1298 microversion: 2.1 time: 0.137027 Oct 27 01:19:44.269217 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 66/120] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:44 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:44.876016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:44.876805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:44.886205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.905303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.907174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.910392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.939422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:44.940939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:44.955383 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.957923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:44.963452 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:44.966400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:45.303008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:45.325463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:45.330400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:45.337626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e3af602c-74c9-4f1e-bfb4-d7742e6abcd2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.465251 Oct 27 01:19:45.341345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 55/121] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:44 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:45.353922 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:45.365530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-43439d35-dfb0-4dd1-a4a5-274901e26fea tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.427121 Oct 27 01:19:45.365530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 67/122] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:44 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:45.379213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:45.383743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:45.404129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:45.405363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:45.416114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:45.416505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:45.426603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:45.428808 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:45.436094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:45.436555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:45.439762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:45.439762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:45.718291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:45.749329 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-213d9567-e07c-4058-ac39-acff8d466cb6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1296 microversion: 2.1 time: 0.374144 Oct 27 01:19:45.761074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 68/123] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:45 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1296 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:46.198437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:46.213032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-814539f8-13f4-417e-bf89-4fffa6f2e37b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.856914 Oct 27 01:19:46.221315 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-c66dcd90-dc99-491a-954f-1bbce458f367 req-bc015126-8ea4-444c-87d6-fd45162c543f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:46.227208 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:46.227208 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:46.230485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 56/124] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:45 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:46.235693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c66dcd90-dc99-491a-954f-1bbce458f367 req-bc015126-8ea4-444c-87d6-fd45162c543f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:46.237525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c66dcd90-dc99-491a-954f-1bbce458f367 req-bc015126-8ea4-444c-87d6-fd45162c543f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:46.253096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-c66dcd90-dc99-491a-954f-1bbce458f367 req-bc015126-8ea4-444c-87d6-fd45162c543f service nova] Creating event network-changed:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:19:46.262245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-c66dcd90-dc99-491a-954f-1bbce458f367 req-bc015126-8ea4-444c-87d6-fd45162c543f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367464 Oct 27 01:19:46.263580 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 69/125] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:46.362353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:46.363013 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:46.372957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:46.377184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:46.380701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:46.382353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:46.384477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:46.385184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:46.394776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:46.404983 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:46.406458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:46.407264 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.010776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.019270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.020641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f7b03684-1ac9-4906-b591-ae2ab4edc4c1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.643930 Oct 27 01:19:47.021219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 70/126] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:46 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:47.034631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.035107 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-52f6ea4c-6a7c-4ee7-ad54-fc359fb9a9b5 req-291b5def-db16-42be-bebc-8f30cf90f323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5", "tag": "73eeb8da-a290-4880-831a-db973bd4521e"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:47.036216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.036603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:47.036603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:47.040394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba2ca590-f419-48e8-adbf-97b36153ef03 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.683194 Oct 27 01:19:47.055497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 57/127] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:46 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:47.061975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:47.062604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:47.081348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.081348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.081348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.081348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.093237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-52f6ea4c-6a7c-4ee7-ad54-fc359fb9a9b5 req-291b5def-db16-42be-bebc-8f30cf90f323 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.094227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-52f6ea4c-6a7c-4ee7-ad54-fc359fb9a9b5 req-291b5def-db16-42be-bebc-8f30cf90f323 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.109522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-52f6ea4c-6a7c-4ee7-ad54-fc359fb9a9b5 req-291b5def-db16-42be-bebc-8f30cf90f323 service nova] Creating event network-changed:73eeb8da-a290-4880-831a-db973bd4521e for instance cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 on hv-cinder-81556 Oct 27 01:19:47.115226 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-52f6ea4c-6a7c-4ee7-ad54-fc359fb9a9b5 req-291b5def-db16-42be-bebc-8f30cf90f323 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092692 Oct 27 01:19:47.116600 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 71/128] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:47.243644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.251028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba7e5a38-e030-4b93-a63c-c33b99709516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.194251 Oct 27 01:19:47.251625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 58/129] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:47 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:47.256208 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:47.256938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:47.263165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.263673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.269548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.269548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.434150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-5aaf45ec-1540-4790-bebf-7e053f5d8a55 req-3f5fb500-c017-4c00-959c-9e363f44ebf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb", "name": "network-vif-plugged", "status": "completed", "tag": "d57d358b-f7a1-474b-ac04-7171ac14de0f"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:47.442405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:47.442405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:47.449216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:47.450808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-5aaf45ec-1540-4790-bebf-7e053f5d8a55 req-3f5fb500-c017-4c00-959c-9e363f44ebf5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:47.453857 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-5aaf45ec-1540-4790-bebf-7e053f5d8a55 req-3f5fb500-c017-4c00-959c-9e363f44ebf5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:47.457597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-26adbef2-55e9-405a-bf3b-fc0ccfdcfb30 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.204856 Oct 27 01:19:47.458632 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 59/130] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:47 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:47.472043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-5aaf45ec-1540-4790-bebf-7e053f5d8a55 req-3f5fb500-c017-4c00-959c-9e363f44ebf5 service nova] Creating event network-vif-plugged:d57d358b-f7a1-474b-ac04-7171ac14de0f for instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb on hv-cinder-81556 Oct 27 01:19:47.477143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-5aaf45ec-1540-4790-bebf-7e053f5d8a55 req-3f5fb500-c017-4c00-959c-9e363f44ebf5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359022 Oct 27 01:19:47.486988 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 72/131] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:48.039694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:48.040680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:48.049040 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.049555 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.050631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.051198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.064580 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:48.065564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:48.074660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.075317 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.076840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.077419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.415672 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.423541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.434533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.437644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.439451 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b35e78e8-774f-47df-a982-1026599c7fab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.379995 Oct 27 01:19:48.440024 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 73/132] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:48 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:48.444696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:48.445513 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:48.445861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9366c593-c627-4b52-ba15-44bca588b9d5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.409587 Oct 27 01:19:48.449143 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 60/133] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:48 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:48.453978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.454653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.456978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.458566 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.478669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:48.480466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:48.491660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.491660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.491660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:48.491660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:48.666517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.670538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:48.684782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-157d030e-3312-4e32-935e-6fe88790433f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.243718 Oct 27 01:19:48.685366 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 74/134] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:48 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:48.686997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-87804e47-cb63-492d-8eb4-b3ef6688d2b2 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.214741 Oct 27 01:19:48.688045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 61/135] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:48 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:49.160843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-697540b7-4e85-456f-ae42-696b38f0033e req-b7cbe743-79f3-4edd-ae5e-12820e500f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cfc0a7-3f5a-4d41-abb9-e80fc370962f", "tag": "e4440d0d-eda6-40ea-8ff3-ed879ecaf17e"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:49.163141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:49.163141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:19:49.179423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-697540b7-4e85-456f-ae42-696b38f0033e req-b7cbe743-79f3-4edd-ae5e-12820e500f56 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.182700 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-697540b7-4e85-456f-ae42-696b38f0033e req-b7cbe743-79f3-4edd-ae5e-12820e500f56 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.208009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-697540b7-4e85-456f-ae42-696b38f0033e req-b7cbe743-79f3-4edd-ae5e-12820e500f56 service nova] Creating event network-changed:e4440d0d-eda6-40ea-8ff3-ed879ecaf17e for instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f on hv-cinder-81556 Oct 27 01:19:49.222166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-697540b7-4e85-456f-ae42-696b38f0033e req-b7cbe743-79f3-4edd-ae5e-12820e500f56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062316 Oct 27 01:19:49.223552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 62/136] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:49.465892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:49.467312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:49.470633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:49.472232 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:49.474297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.475669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.476667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.477453 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.482140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.482605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.483741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.484439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.678697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.689726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.699763 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a4f87664-3591-4a44-ab8a-0ba1083123c8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.233385 Oct 27 01:19:49.699763 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 75/137] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:49 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:49.710988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.712745 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.714460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6a50a857-7e86-4606-802f-9e04baa90dd4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.250944 Oct 27 01:19:49.724628 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:49.725299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:49.731300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 63/138] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:49 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:19:49.734397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:49.735230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:49.742126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.742679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.743504 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.744001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.747355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.747796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.750481 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:49.750918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:49.953370 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.962130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-824b4f1c-ea3f-427b-9273-fbd6e453649f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.262684 Oct 27 01:19:49.962716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 76/139] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:49 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:49.965801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:49.979194 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f10d2de6-061c-48da-8c9c-7d51d655caf7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1315 microversion: 2.1 time: 0.248469 Oct 27 01:19:49.980089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 64/140] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:49 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:50.716466 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:50.717129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:50.723602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.726799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:50.729655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.730337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:50.732856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:50.733493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:50.771428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.772606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:50.778227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.779411 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:50.925094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:50.933022 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6a847817-6b22-4a8c-ba87-55ebf1d26bd6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.220319 Oct 27 01:19:50.933603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 77/141] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:50 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:50.964287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:50.973062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:50.976151 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:50.977533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-441a6c0c-aa06-4706-911b-c1774a4e7f5b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.249190 Oct 27 01:19:50.980045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:50.980658 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:50.988895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 65/142] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:50 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:19:50.989531 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.989980 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:50.993571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:50.993571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:51.000276 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:51.001222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:51.008867 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:51.010450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:51.013251 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:51.013741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:51.242685 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:51.252992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8d301bc0-1207-4eed-9ecc-de13f631b6bb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.277787 Oct 27 01:19:51.266387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:51.269600 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 78/143] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:50 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:51.274497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-48134321-8721-4b1d-b5bb-86c10aee1ea7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1501 microversion: 2.1 time: 0.278869 Oct 27 01:19:51.275069 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 66/144] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:50 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:51.949808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:51.950519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:51.957836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:51.958562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:51.960249 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:51.961117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:51.997239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:52.002753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:52.007472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:52.008001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:52.008835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:52.009532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:52.148323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:52.158111 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6ba82db8-63b2-4ad4-b7bd-74d99ee0c0f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.211758 Oct 27 01:19:52.158767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 79/145] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:51 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:52.213162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:52.221414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:52.226988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:52.226988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0f381eab-2d5d-49ef-815c-bc30ad7bfabe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.232004 Oct 27 01:19:52.226988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 67/146] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:51 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:52.273536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:52.273536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:52.281620 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:52.282178 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:52.283008 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:52.283441 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:52.543599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:52.553301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d5d18fe6-f891-4292-a4f6-499ad7535b33 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.286555 Oct 27 01:19:52.557797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 80/147] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:52 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:52.995550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b09096c7-b135-456e-8fcd-58d29c57dca0"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:52.998114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:53.011615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.012275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.013080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.013505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.175424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:53.176026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:53.183425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.184015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.184988 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.185424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.337753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:53.358442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3b7e078c-b5ec-4697-b4f8-61c53395654d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.186415 Oct 27 01:19:53.359283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 81/148] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:53 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:53.377331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:53.377331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:53.383608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.384076 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.384906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.385332 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.515890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:53.524327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:53.538213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:53.538213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-35da2b09-1450-4b04-8eb7-8c49f2ac8254 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.159965 Oct 27 01:19:53.538213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 82/149] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:53 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:53.581857 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:53.582500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:53.588303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.588751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.589514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:53.589948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:53.749430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:53.759132 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3d359975-478f-4ee7-938c-86dd0a137ac4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.180761 Oct 27 01:19:53.759776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 83/150] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:53 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:19:54.093247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eda6ed95-d179-4d2f-a52b-cb42a9ac9610 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "POST /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.101676 Oct 27 01:19:54.093948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 68/151] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:19:52 2021] POST /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:54.376425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:54.378702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:54.383837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.384265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.385232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.385651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.510953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:54.518714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9d6bfe74-64c3-4c62-af8a-b8ae399de42f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.145915 Oct 27 01:19:54.528373 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 84/152] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:54 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:54.547427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:54.548110 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:54.554954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.555617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.556534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.557106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.686422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:54.695099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:54.696614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:54.697848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2c56d779-3d0a-4cba-b16f-f8b504578575 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.154997 Oct 27 01:19:54.698439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 69/153] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:54 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:54.782608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:54.782608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:54.783841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.784371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.785231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:54.785720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:54.912070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:54.919851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3bdc7a1d-4374-484c-94a2-ec8ce106e951 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.146753 Oct 27 01:19:54.920420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 85/154] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:54 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:55.535601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:55.536206 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:55.542361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.542809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.543663 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.544056 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.665240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:55.672371 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2841f83b-1278-4b59-a0c0-c5ada1541c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.140378 Oct 27 01:19:55.672937 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 70/155] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:55 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:55.715528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:55.716129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:55.722165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.722613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.723361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.723791 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.858863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:55.867457 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:55.869018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:55.870367 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0a1ea57e-fc3d-47fe-b47f-89272b975a2e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.158435 Oct 27 01:19:55.870913 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 86/156] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:55 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:55.936594 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:55.937203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:55.943758 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.944198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.944955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.945374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.968909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-72c7ed5c-ef92-4fe2-a6a6-b5cc89e49aea req-fb5372c5-28bc-4e11-9088-11ce8f7687a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c00af12-ba9b-4253-8e58-985becdb2ad0", "name": "network-vif-plugged", "status": "completed", "tag": "4f1eccc2-4d63-4101-be4a-ce4e532f88e2"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:55.970998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:55.970998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:55.980573 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-72c7ed5c-ef92-4fe2-a6a6-b5cc89e49aea req-fb5372c5-28bc-4e11-9088-11ce8f7687a7 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:55.981005 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-72c7ed5c-ef92-4fe2-a6a6-b5cc89e49aea req-fb5372c5-28bc-4e11-9088-11ce8f7687a7 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:55.993163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-72c7ed5c-ef92-4fe2-a6a6-b5cc89e49aea req-fb5372c5-28bc-4e11-9088-11ce8f7687a7 service nova] Creating event network-vif-plugged:4f1eccc2-4d63-4101-be4a-ce4e532f88e2 for instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 on hv-cinder-81556 Oct 27 01:19:55.998788 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-72c7ed5c-ef92-4fe2-a6a6-b5cc89e49aea req-fb5372c5-28bc-4e11-9088-11ce8f7687a7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033182 Oct 27 01:19:55.999972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 87/157] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:56.087781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:56.094845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6c16b488-65b7-4e8f-96aa-833dba6ce505 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.162081 Oct 27 01:19:56.095672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 71/158] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:55 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:56.690330 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:56.691021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:56.697319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:56.697761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:56.698547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:56.698977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:56.869287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:56.876773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3851e4ec-f894-47d5-a60c-445033554887 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.190415 Oct 27 01:19:56.877339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 88/159] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:56 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:56.891237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:56.891237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:56.895815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:56.896247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:56.897733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:56.898356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:57.038328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:57.049054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:57.050588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:57.051771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3b12669e-54a1-42be-91e8-71dabc926d52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.167757 Oct 27 01:19:57.054770 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 72/160] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:56 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:57.112483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:57.113170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:57.119955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:57.163952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:57.163952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:57.163952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:57.262052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:57.269793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ba2059af-8964-49e9-a95d-e8e8596b4dcd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.161255 Oct 27 01:19:57.270569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 89/161] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:57 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:57.894578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:57.895738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:57.904604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:57.905216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:57.905984 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:57.906446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.016210 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5", "name": "network-vif-plugged", "status": "completed", "tag": "73eeb8da-a290-4880-831a-db973bd4521e"}, {"server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "name": "network-vif-plugged", "status": "completed", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}, {"server_uuid": "99cfc0a7-3f5a-4d41-abb9-e80fc370962f", "name": "network-vif-plugged", "status": "completed", "tag": "e4440d0d-eda6-40ea-8ff3-ed879ecaf17e"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:19:58.018058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:58.018058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:19:58.026916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:58.027521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.029396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:58.036696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-97a17304-a44e-4793-9503-790ece9ba343 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.146345 Oct 27 01:19:58.037362 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 73/162] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:57 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:58.041899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Creating event network-vif-plugged:73eeb8da-a290-4880-831a-db973bd4521e for instance cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 on hv-cinder-81556 Oct 27 01:19:58.042467 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Creating event network-vif-plugged:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:19:58.043121 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] Creating event network-vif-plugged:e4440d0d-eda6-40ea-8ff3-ed879ecaf17e for instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f on hv-cinder-81556 Oct 27 01:19:58.050709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-41ebfd6f-abcb-47f5-8789-d0016f3126f2 req-daaf98de-5d1a-4096-9995-4bfafb873420 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038119 Oct 27 01:19:58.051313 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 90/163] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:19:58.072120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:58.072698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:58.078435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:58.078869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.079605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:58.080025 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.199636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:58.207440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:58.209621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:58.210759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-097fabcc-02fe-447e-b8f9-d6f6296e2519 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.142872 Oct 27 01:19:58.211317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 74/164] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:58 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:58.287390 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:58.288722 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:58.294180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:58.294709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.295456 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:58.295876 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:58.417825 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:58.425045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4ad44bfa-41e8-450f-b520-52756cf3ff72 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.141615 Oct 27 01:19:58.425600 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 91/165] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:58 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:59.053419 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:59.054020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:59.060374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.060811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.062606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.062606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.188083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:59.199099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ca472012-ccd5-4b5f-81d2-ae18e335612c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.149326 Oct 27 01:19:59.199669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 75/166] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:59 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:59.228982 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:59.229738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:59.235816 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.236256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.237013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.237441 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.356988 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:59.364846 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:59.366353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:59.367606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ae5b9ecf-dd75-413c-9c70-ecf01f0ae72f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.142940 Oct 27 01:19:59.368149 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 92/167] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:19:59 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:59.441852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:59.442478 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:19:59.448764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.449210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.449957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:19:59.450412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:19:59.569540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:19:59.576679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-87e95967-bfa3-4e6f-846b-443b1c51568e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.138590 Oct 27 01:19:59.577242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 76/168] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:19:59 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:00.216172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:00.216797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:00.222563 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.223001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.223744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.224197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.385282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:00.385886 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:00.392450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.392961 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.393788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.394252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.566982 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:00.572702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:00.575064 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-90107e9c-b55e-4267-8694-deb0a45cea2d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.362570 Oct 27 01:20:00.575645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 93/169] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:00 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:00.580786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:00.582311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:00.583437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4215e8e3-929f-46fb-9910-593e8d16e861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.202523 Oct 27 01:20:00.583987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 77/170] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:00 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:20:00.592626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:00.593232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:00.598998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.599442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.600232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:00.600664 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:00.719702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:00.727453 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1df3870b-a0d5-4d11-9f36-cb6b3c380b22 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.138584 Oct 27 01:20:00.734181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 94/171] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:00 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:01.592159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:01.592767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:01.598977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.599421 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.600182 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.600275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:01.600651 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.600859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:01.606540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.606972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.607716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.608138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.774903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:01.777875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:01.782096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16ecf1b9-04d1-4ce1-831b-ad7f1adad2dd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.193549 Oct 27 01:20:01.782679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 78/172] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:01 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:01.785619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:01.786907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:01.787273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:01.787501 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:01.788912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3ffdbeff-e7ac-4232-b0db-1ca8dc72a76a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.191775 Oct 27 01:20:01.789448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 95/173] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:01 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:20:01.794073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.794540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.795313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:01.795741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:01.914295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:01.921370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-be6a8b92-6845-4ad3-bd45-5caef39bb6be tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.137776 Oct 27 01:20:01.921938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 79/174] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:01 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:02.799043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:02.799641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:02.806491 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:02.806740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:02.807136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:02.807284 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:02.807668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:02.808090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:02.813569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:02.814004 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:02.814806 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:02.815225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:02.982170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:02.987655 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:02.990839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a618fddc-6a10-45c0-af16-9203910abc58 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.194960 Oct 27 01:20:02.991056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 96/175] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:02 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:03.000279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:03.000437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:03.000551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:03.000626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:03.000626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9ff13df0-eaca-4c4e-af1b-ce691f7de837 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.196490 Oct 27 01:20:03.002428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:03.002874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:03.003675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:03.004046 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:03.008648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 80/176] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:02 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:20:03.120365 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:03.127395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-098af5bd-65a8-4a7c-b692-751dd9ae4ff4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.134686 Oct 27 01:20:03.127948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 97/177] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:02 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:04.008201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:04.008858 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:04.015484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.015932 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.016698 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:04.017118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.017209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.017305 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:04.023773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.024407 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.025186 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.025623 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.199634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:04.202306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:04.207239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-351c217a-17ba-4993-a02c-eaf0968fbccd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.203539 Oct 27 01:20:04.207854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 81/178] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:04 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:04.210531 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:04.212232 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:04.212447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:04.212825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:04.213533 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f500b917-bbd1-422e-9d86-a395696b71ff tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.200462 Oct 27 01:20:04.214311 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 98/179] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:04 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:20:04.218874 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.219345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.220097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:04.220519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:04.342680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:04.350240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0f1e88ce-5127-4706-b0fa-1f392fba7e04 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.141412 Oct 27 01:20:04.350858 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 82/180] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:04 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:05.235511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:05.236257 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:05.237951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:05.238623 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:05.243992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.244438 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.244580 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.245222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.245331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.245670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.246108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.246544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.446202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:05.446348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:05.446454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:05.446454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:05.446958 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-89eeace1-d304-4a96-957b-96c0de404cf8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1407 microversion: 2.20 time: 0.217877 Oct 27 01:20:05.448069 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 83/181] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:05 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:20:05.452605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:05.453395 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:05.460792 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.461541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.462305 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1d86623d-acfc-478b-b302-8d6d9757f62e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.242182 Oct 27 01:20:05.462889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:05.463167 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 99/182] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:05 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:05.463406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:05.595377 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:05.603592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d9499392-c7eb-4d8c-8df3-e87536ba506b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.154308 Oct 27 01:20:05.604162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 84/183] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:05 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:06.464940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:06.465547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:06.471551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.482003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:06.482003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:06.494843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.495285 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.496060 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.496489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.497526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.498490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.498925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.682697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:06.689473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:06.698241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:06.698419 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a4dbe260-6534-4ff7-8c13-e6833bf882ef tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1321 microversion: 2.1 time: 0.222400 Oct 27 01:20:06.698419 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 85/184] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:06 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:06.698584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:06.699667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0eda1487-2256-455a-9448-e65e186df679 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1598 microversion: 2.20 time: 0.238579 Oct 27 01:20:06.706334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 100/185] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:20:06 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1598 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:20:06.706488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:06.706488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:06.708402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.708846 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.709597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.710657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.734677 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:06.736255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:06.745750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.746233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.747012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:06.747446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:06.908045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:06.916047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1915ba72-2a02-4928-806a-ce10b61d2ca0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1364 microversion: 2.1 time: 0.217251 Oct 27 01:20:06.916716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 86/186] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:06 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:06.924907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2114e26f-143a-4257-a6dd-c6c3cf2cf092 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.210603 Oct 27 01:20:06.930696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 101/187] 10.222.0.32 () {60 vars in 1315 bytes} [Wed Oct 27 01:20:06 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:07.712972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:07.713581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:07.719848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.720339 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:07.721301 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.721737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:07.847897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:07.856391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2382f879-34aa-4217-89dd-11f5e382b2e8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1515 microversion: 2.1 time: 0.147149 Oct 27 01:20:07.868868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 87/188] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:07 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:07.879762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:07.883085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:07.892943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.893589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:07.894694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.895462 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:07.928712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'flavor' on Instance uuid cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:20:07.946267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:07.946267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:07.946267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.946267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:07.946686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:07.946686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.079145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:08.087474 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-30966a7a-34d9-48a9-8271-e2e264c9c31d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1549 microversion: 2.1 time: 0.155206 Oct 27 01:20:08.089006 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 88/189] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:07 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:08.107620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:08.108757 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:08.116270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.116919 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.117708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.118233 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.229246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b991682a-f912-41ba-9cfa-189101df8d8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123451 Oct 27 01:20:08.229246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 89/190] 10.222.0.32 () {58 vars in 1274 bytes} [Wed Oct 27 01:20:08 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:20:08.361515 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:08.362772 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:08.363128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e27bcc2b-0ae1-484d-948d-e18dc9af3819 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5/action" status: 200 len: 32 microversion: 2.1 time: 0.492469 Oct 27 01:20:08.367595 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 102/191] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:07 2021] POST /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:08.373305 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-895cd15b-e211-452b-b684-90d477864904 req-abcf7cae-14f7-4326-a67a-0c0374ccc6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:08.375984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:08.375984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:20:08.383017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.384514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.385541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.386263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.386700 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-895cd15b-e211-452b-b684-90d477864904 req-abcf7cae-14f7-4326-a67a-0c0374ccc6c6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.387188 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-895cd15b-e211-452b-b684-90d477864904 req-abcf7cae-14f7-4326-a67a-0c0374ccc6c6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.400138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-895cd15b-e211-452b-b684-90d477864904 req-abcf7cae-14f7-4326-a67a-0c0374ccc6c6 service nova] Creating event network-changed:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:20:08.406254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-895cd15b-e211-452b-b684-90d477864904 req-abcf7cae-14f7-4326-a67a-0c0374ccc6c6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039863 Oct 27 01:20:08.414389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 103/192] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:20:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:20:08.416760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:08.417524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:08.424361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.424361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.425137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:08.425562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:08.520192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4e27a1c7-e3e4-4492-954f-142c4b256f04 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.163832 Oct 27 01:20:08.521000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 90/193] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:08 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:08.708885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:08.722233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-63eb7736-4c30-4c75-88d1-39e78e276840 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.310843 Oct 27 01:20:08.723331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 104/194] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:08 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:09.533861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:09.537145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:09.553751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:09.559300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:09.563818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:09.564273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:09.707926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-98caf97e-e6b4-4074-96c9-d4ef65886bb6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.179206 Oct 27 01:20:09.711417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 91/195] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:09 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:09.742260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:09.744870 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:09.751422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:09.752206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:09.753318 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:09.754404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:09.990563 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:09.998743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5d6f7360-c21f-41f5-9a5b-ce696bff757a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.260489 Oct 27 01:20:09.999324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 105/196] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:09 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:10.151488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:10.154896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:10.156256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-735ea7ac-9a5b-47af-a208-6f158806abe3 req-43d0f3fc-399b-491f-92b7-054dd7aa711c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cfc0a7-3f5a-4d41-abb9-e80fc370962f", "tag": "e4440d0d-eda6-40ea-8ff3-ed879ecaf17e"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:10.157819 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:10.157819 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:20:10.174574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:10.175015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:10.180130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:10.180130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:10.185188 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-735ea7ac-9a5b-47af-a208-6f158806abe3 req-43d0f3fc-399b-491f-92b7-054dd7aa711c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:10.185910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-735ea7ac-9a5b-47af-a208-6f158806abe3 req-43d0f3fc-399b-491f-92b7-054dd7aa711c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:10.208220 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-735ea7ac-9a5b-47af-a208-6f158806abe3 req-43d0f3fc-399b-491f-92b7-054dd7aa711c service nova] Creating event network-changed:e4440d0d-eda6-40ea-8ff3-ed879ecaf17e for instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f on hv-cinder-81556 Oct 27 01:20:10.216084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-735ea7ac-9a5b-47af-a208-6f158806abe3 req-43d0f3fc-399b-491f-92b7-054dd7aa711c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068692 Oct 27 01:20:10.217812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 106/197] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:20:10.331195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7b52c501-3c2b-48aa-b4e6-cf73c792621e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.188605 Oct 27 01:20:10.332157 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 92/198] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:10 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:10.720690 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:10.722067 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:10.731935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:10.732478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:10.733523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:10.734016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:10.912723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-591818d3-c960-4eb0-b680-5886be531221 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.196606 Oct 27 01:20:10.916778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 107/199] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:10 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:11.016694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:11.017540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:11.034771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.035237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:11.036060 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.039167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:11.263495 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:11.272603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0346cd2d-bfc3-402a-8b91-493aaf665e2f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.260787 Oct 27 01:20:11.273512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 93/200] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:11 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:11.344109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:11.345129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:11.352089 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.361293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:11.361293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.361293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:11.466009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-18eda0ed-bc67-4984-b237-603b6c52ab63 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.126079 Oct 27 01:20:11.466909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 108/201] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:11 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:11.923301 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:11.924216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:11.931237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.931661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:11.932415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:11.932841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:12.056771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-303dea86-cd88-4d7d-b22d-b1af20f548e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.137021 Oct 27 01:20:12.057492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 94/202] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:11 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:12.290789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:12.291558 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:12.298565 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:12.299256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:12.300206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:12.300880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:12.434294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:12.447109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ba96598b-ce10-477e-a97b-bfcfeb5da494 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.161179 Oct 27 01:20:12.450263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 109/203] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:12 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:12.478279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:12.479370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:12.487269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:12.489918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:12.489918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:12.489918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:12.624657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3a776b1f-1a69-42a8-8413-a7ab15d03b51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.151303 Oct 27 01:20:12.626127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 95/204] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:12 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:13.068378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:13.069456 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:13.076736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.077135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.078621 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.078621 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.214279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cf667729-81cc-4177-8e18-17bb6bd88418 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.150273 Oct 27 01:20:13.214911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 110/205] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:13 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:13.474195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:13.474195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:13.483949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.483949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.484192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.484799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.618646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:13.626253 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2275978b-e30f-4045-865d-f4e654c1c640 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.157325 Oct 27 01:20:13.626818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 96/206] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:13 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:13.636748 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:13.637747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:13.644379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.644825 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.645578 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.646006 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.757635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b22f8152-1dd6-423c-a55d-cb280e1e490f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.125187 Oct 27 01:20:13.761389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 111/207] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:13 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:13.762446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:13.763006 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:13.769254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.769699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.770574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:13.771007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:13.797033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:20:14.048800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-db58c6a0-1934-4e38-8086-95120d7f46d7 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 204 len: 0 microversion: 2.1 time: 0.290515 Oct 27 01:20:14.049707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 97/208] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:20:13 2021] DELETE /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:20:14.060005 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:14.060701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:14.067423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.067867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.068643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.069176 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.225552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:14.226647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:14.234015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.245454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.246566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.248583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.276396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:14.286681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-56704d0b-55a1-4b65-9141-908fec0d047b tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1553 microversion: 2.1 time: 0.231278 Oct 27 01:20:14.287282 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 112/209] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:14 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:14.380339 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ec1ce9dd-d3e6-4ee5-9a4f-72da6f86eb3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.159003 Oct 27 01:20:14.384406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 98/210] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:14 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:14.644284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:14.644889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:14.654085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.654543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.655322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.656114 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.769666 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:14.777904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:14.785591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.786076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.786841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:14.787270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:14.832500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:14.842624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c35ef763-9c95-4833-a707-f692f5f81247 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.202066 Oct 27 01:20:14.843799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 113/211] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:14 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:14.959159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-66faeee1-6320-4855-a76a-9eda9f94163f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.193698 Oct 27 01:20:14.960016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 99/212] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:14 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:15.305374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:15.306051 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:15.312185 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.312622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:15.313380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.313976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:15.391863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:15.392815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:15.404211 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.404650 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:15.405614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.406393 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:15.472182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:15.480711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dcf30bdd-7960-4da5-a12e-1d093f9830c6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1553 microversion: 2.1 time: 0.179152 Oct 27 01:20:15.481294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 114/213] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:15 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:15.860241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:15.860838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:15.867395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.868666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:15.869635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:15.870292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:16.004540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:16.011415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-10a52cb0-0ad4-406a-a7d7-a1e865443984 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.154948 Oct 27 01:20:16.012879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 115/214] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:15 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:16.043385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:16.044734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:16.052792 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:16.053388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:16.054370 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:16.054939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:18.234689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-236a7256-68c0-4e05-b013-9dc8409ac65c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 2.846679 Oct 27 01:20:18.237764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 100/215] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:15 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:18.240275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:18.240982 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:18.248563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:18.248995 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:18.250107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:18.250535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:18.289168 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-aff9862f-36f6-48bd-bbdb-83276f54223e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 2.274766 Oct 27 01:20:18.289846 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 116/216] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:16 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:18.295216 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:18.296080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:18.304048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:18.305103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:18.306292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:18.306903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:18.491222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:18.499713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:18.500065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-42ba8281-b268-4c58-854e-203048d1b4cd tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1553 microversion: 2.1 time: 0.263523 Oct 27 01:20:18.500648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 101/217] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:18 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:18.508170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-50e18a30-2670-41ad-8707-0dced2d84d2a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.216916 Oct 27 01:20:18.509995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 117/218] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:18 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:19.245676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:19.248037 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:19.256267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.256999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.258495 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.260172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.301787 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:19.302740 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:19.309068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.309744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.310704 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.311135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.409227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7aa5c5e3-aff2-46c8-904b-2ff0a002a4d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.167770 Oct 27 01:20:19.412422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 102/219] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:19 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:19.449422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-353b4fc3-0590-46a5-9999-711b5c6474d8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.152736 Oct 27 01:20:19.450250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 118/220] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:19 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:19.519361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:19.520470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:19.527971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:19.528845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:19.529309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.529848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.530756 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.531271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.536885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.537527 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.538395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:19.538985 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:19.721452 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:19.729510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:19.738533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4673b512-7827-4250-b8d2-6bf8bbdc45db tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1553 microversion: 2.1 time: 0.224316 Oct 27 01:20:19.739717 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 103/221] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:19 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:19.747386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bf74337c-9784-451c-accf-8d55d72f390f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.223021 Oct 27 01:20:19.747386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 119/222] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:19 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:20.427680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:20.433688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:20.441907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.442600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.443604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.444167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.460523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:20.462463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:20.481322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.481877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.482721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.485525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.585821 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-53ba0b6d-ff10-4ba6-b7ac-8dffa5eb4b58 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.168684 Oct 27 01:20:20.587081 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 104/223] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:20 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:20.620348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7ad6a3bd-bad8-41b9-8659-d0040f3f2d09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.163176 Oct 27 01:20:20.621316 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 120/224] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:20 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:20.758556 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:20.759449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:20.768392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:20.769915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:20.771199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.771672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.774510 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.778224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.780603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.781098 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:20.782093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:20.782838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.022103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:21.030222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:21.037562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5f55bf87-deec-497b-9909-3a6369d0d8f6 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1553 microversion: 2.1 time: 0.284422 Oct 27 01:20:21.039866 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 105/225] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:20 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:21.041430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-338c8f88-6341-484d-bb79-9f95ccea97c9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.278840 Oct 27 01:20:21.041950 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 121/226] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:20 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:21.274680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-b20bd936-5ce0-49f0-ae5d-466c58d0c0b1 req-be45fcf4-30f5-4c15-80dd-a2f6410358b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb", "name": "network-vif-deleted", "tag": "d57d358b-f7a1-474b-ac04-7171ac14de0f"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:21.276678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:21.276678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:20:21.284683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-b20bd936-5ce0-49f0-ae5d-466c58d0c0b1 req-be45fcf4-30f5-4c15-80dd-a2f6410358b5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:21.285149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-b20bd936-5ce0-49f0-ae5d-466c58d0c0b1 req-be45fcf4-30f5-4c15-80dd-a2f6410358b5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.298542 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-b20bd936-5ce0-49f0-ae5d-466c58d0c0b1 req-be45fcf4-30f5-4c15-80dd-a2f6410358b5 service nova] Creating event network-vif-deleted:d57d358b-f7a1-474b-ac04-7171ac14de0f for instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb on hv-cinder-81556 Oct 27 01:20:21.305598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-b20bd936-5ce0-49f0-ae5d-466c58d0c0b1 req-be45fcf4-30f5-4c15-80dd-a2f6410358b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036463 Oct 27 01:20:21.306658 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 106/227] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:20:21.597231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:21.598195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:21.605665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:21.606112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.606875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:21.607307 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.632221 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:21.633572 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:21.639722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:21.640154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.640898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:21.641320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:21.741284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a0204261-44ae-4a29-8044-4a1cfa36d4e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.147595 Oct 27 01:20:21.741929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 122/228] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:21 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:21.778759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-18090104-8ade-454f-aed1-29414a7e5ec9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.150759 Oct 27 01:20:21.779578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 107/229] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:21 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:20:22.056159 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:22.057251 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:22.059164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:22.059854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:22.066302 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.070149 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.071162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.071162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.071639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.072073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.076723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.077408 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.172744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11b35bf64df44739ab333b4f130d23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341b274900784c5f8f6e3b7f10f80cc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:22.181436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-50ba8209-1176-4dd1-9180-ba011669fca9 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 200 len: 1346 microversion: 2.1 time: 0.129292 Oct 27 01:20:22.182276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 123/230] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:22 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 1346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:22.246071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:22.254318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-26775ec0-b82b-4da3-a15b-52ebc50c463d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.200106 Oct 27 01:20:22.254892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 108/231] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:22 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:22.752810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:22.753706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:22.760310 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.760807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.761564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.761999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.788449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:22.812311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:22.812311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.812311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.812311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:22.812843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:22.901889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a7e93a2f-b26f-4c05-83ee-baa764840e46 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14 microversion: 2.20 time: 0.152543 Oct 27 01:20:22.902589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 124/232] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:22 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:22.923871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9ca5d6cb-8998-4a3b-84c4-75d64c6401bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.138788 Oct 27 01:20:22.924490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 109/233] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:22 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:20:23.201141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:23.202152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:23.212577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.212748 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.213660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.213997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.232218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] HTTP exception thrown: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. Oct 27 01:20:23.233339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Returning 404 to user: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:20:23.234285 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-02e14f73-4f77-48db-a58a-bc58a67ecd3e tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 404 len: 111 microversion: 2.1 time: 0.039433 Oct 27 01:20:23.235018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 125/234] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:23 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:20:23.272121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:23.272793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:23.280215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.280706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.281622 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.282077 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.345895 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:23.346852 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:23.352958 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.353409 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.354206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.354636 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.369465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] HTTP exception thrown: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. Oct 27 01:20:23.370263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Returning 404 to user: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:20:23.371077 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2024c994-df91-481e-80bc-db3a6617bdf1 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028982 Oct 27 01:20:23.372012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 126/235] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:20:23 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:20:23.414976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:23.424492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1ad7db4b-ad5b-4506-a6e5-b5e8cd013bff tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.157181 Oct 27 01:20:23.425389 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 110/236] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:23 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:23.913529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:23.915946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:23.926778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.926778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.926778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.927237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.940911 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:23.942255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:23.952270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.952720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:23.953528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:23.954080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:24.077450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-676b280d-bfdf-4949-bb1c-fcfb448243e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 1162 microversion: 2.20 time: 0.168463 Oct 27 01:20:24.079065 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 127/237] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:23 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 1162 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:20:24.118952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8c3a1f24-f68a-45fb-9f09-dec893aa50de tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 14 microversion: 2.1 time: 0.182671 Oct 27 01:20:24.119611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 111/238] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:23 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:24.447616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:24.449451 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:24.455348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:24.455977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:24.457674 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:24.458290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:24.692134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:24.710586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c5735f01-88bc-4290-9c1d-4bc340356fd3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.270682 Oct 27 01:20:24.713866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 128/239] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:24 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:25.010458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:25.010458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:25.010458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.010458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.011309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.011309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.011309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] HTTP exception thrown: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. Oct 27 01:20:25.011309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Returning 404 to user: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:20:25.012073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f8ab999d-57d9-4d15-aa86-da57071a2dc4 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 404 len: 111 microversion: 2.1 time: 0.029194 Oct 27 01:20:25.012073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 112/240] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:20:24 2021] DELETE /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:20:25.012733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:25.012733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] [instance: 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:25.012733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.012733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.013433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.013433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.013433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] HTTP exception thrown: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. Oct 27 01:20:25.013433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] Returning 404 to user: Instance 6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:20:25.013433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-539607b5-ea7f-4c0f-883c-44581fcdc612 tempest-DeleteServersTestJSON-490564784 tempest-DeleteServersTestJSON-490564784-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb" status: 404 len: 111 microversion: 2.1 time: 0.027298 Oct 27 01:20:25.013910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 129/241] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:24 2021] GET /compute/v2.1/servers/6bc0bfc2-6edd-4fc7-a7f7-f6bcfade4dbb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:20:25.089863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:25.090799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:25.096974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.097411 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.098191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.098618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.215645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:25.215645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:25.215645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.215645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.216999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.216999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.247702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-911d46fa-8880-4b23-a8d6-e0a5d0b22a41 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 8596 microversion: 2.20 time: 0.162321 Oct 27 01:20:25.251184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 113/242] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:25 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 8596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:20:25.296493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-544491a9-37b9-4cc2-834d-ce92e5a7e1b3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 7012 microversion: 2.1 time: 0.165229 Oct 27 01:20:25.297303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 130/243] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:25 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 7012 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:25.730204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:25.731018 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:25.738787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.738787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:25.739425 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:25.739853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:26.093892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:26.101342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d12f8727-c6ff-4a9e-a6a2-2257d12dfabc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.375876 Oct 27 01:20:26.102628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 114/244] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:25 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:26.262616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:26.263860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:26.274778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:26.276141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:26.281579 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:26.282523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:26.307456 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:26.308634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:26.317470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:26.317916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:26.318831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:26.319266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:26.447355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b4dd977b-a1f4-4ec8-8710-3972c76ce504 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 14218 microversion: 2.20 time: 0.191457 Oct 27 01:20:26.448450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 131/245] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:26 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 14218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:26.477030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-757d44b0-d8f7-4af5-b63e-047ed4329504 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 12367 microversion: 2.1 time: 0.174001 Oct 27 01:20:26.477667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 115/246] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:26 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 12367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:27.120173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:27.121546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:27.131470 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.132443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.134416 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.135054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.278511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:27.286940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-276c96c0-a525-4f07-a6d1-8940224bcc64 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.171164 Oct 27 01:20:27.287837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 132/247] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:27 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:27.459506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:27.460667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:27.469023 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.469774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.471291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.471946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.489815 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:27.491550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:27.506228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.506884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.507860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:27.509559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:27.671553 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-784c49b6-b27d-4f82-a7b1-5835a9a02d4c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 17931 microversion: 2.20 time: 0.216357 Oct 27 01:20:27.672200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 116/248] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:27 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 17931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:27.699323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d8b632ee-cc81-487a-804e-944eee42b26d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 16506 microversion: 2.1 time: 0.214090 Oct 27 01:20:27.700049 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 133/249] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:27 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 16506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:28.307277 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:28.307953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:28.315997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.315997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.316549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.316973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.442690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:28.453226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d9cd2910-35b6-40b4-9bed-de8e25a76f03 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.150648 Oct 27 01:20:28.453819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 117/250] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:28 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:28.690102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:28.690102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:28.697293 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.697405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.698231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.698658 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.714621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:28.714621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:28.722198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.722642 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.724097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:28.724680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:28.829682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f5a03851-fc55-43f3-baff-07b05d2a87c8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 18608 microversion: 2.20 time: 0.150030 Oct 27 01:20:28.830386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 134/251] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:28 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 18608 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:28.870683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3edc85c3-3e73-49bc-8580-69d966717060 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 18155 microversion: 2.1 time: 0.162045 Oct 27 01:20:28.872109 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 118/252] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:28 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 18155 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:29.469851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:29.470564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:29.477522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.477976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.478768 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.479191 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.613187 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:29.624509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7454e1b4-40af-4e13-b801-35c4ecdbd4ec tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.158476 Oct 27 01:20:29.625685 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 135/253] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:29 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:29.842373 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:29.843659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:29.850661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.851330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.853183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.853634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.883419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:29.884329 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:29.890850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.891523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.892289 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:29.892721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:29.980856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-76874891-5e09-4430-8c0f-a0553bce504c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 20991 microversion: 2.20 time: 0.142395 Oct 27 01:20:29.990122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 119/254] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:29 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 20991 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:30.020719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4bbf60a2-e5fe-4219-baad-00503ef3523b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 19446 microversion: 2.1 time: 0.139857 Oct 27 01:20:30.022499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 136/255] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:29 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 19446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:30.641795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:30.642514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:30.649591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:30.650115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:30.650910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:30.651346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:31.000096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:31.001727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:31.009793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:31.010767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:31.011749 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:31.012370 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:31.032866 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:31.042293 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3d211dc4-4fc4-44a9-8892-c74f5c8271b5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.404272 Oct 27 01:20:31.043592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 120/256] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:30 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:31.064781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:31.065749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:31.075888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:31.079747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:31.079747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:31.079747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:31.131455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3af63eb2-0199-4219-9dbe-531e09fcb4f0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 22846 microversion: 2.20 time: 0.135587 Oct 27 01:20:31.133913 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 137/257] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:30 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 22846 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:31.198685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-385e4e4d-f553-4b98-a9eb-1d378c364c53 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 22119 microversion: 2.1 time: 0.144458 Oct 27 01:20:31.199283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 121/258] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:31 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 22119 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:32.060031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:32.060722 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:32.067880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.068330 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.069100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.069534 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.146480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:32.147583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:32.163398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.164156 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.171188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.171188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.242363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:32.250219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c1ee660a-b43f-4c1a-a787-815a09c1aff7 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.194428 Oct 27 01:20:32.250803 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 138/259] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:32 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:32.255637 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:32.256548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:32.263195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.263648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.264422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:32.264853 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:32.284071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-228cb593-cbe5-41d6-8f87-b2cc5ae9b024 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 24517 microversion: 2.20 time: 0.142457 Oct 27 01:20:32.284892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 122/260] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:32 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 24517 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:32.362792 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1eabec8d-8da8-438b-acd9-43790306ffb7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 23804 microversion: 2.1 time: 0.110450 Oct 27 01:20:32.365713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 139/261] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:32 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 23804 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:33.269154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:33.270750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:33.278987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.279682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.280681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.281296 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.297937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:33.300069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:33.310399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.311000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.311920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.312646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.433290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ad1bcd3d-3811-431e-8235-94dcddef7bce tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 25898 microversion: 2.20 time: 0.140287 Oct 27 01:20:33.434049 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 140/262] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:33 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 25898 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:33.439422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:33.440403 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:33.443850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:33.447277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.447716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.448471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:33.448894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:33.451752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8faea3fd-0da9-4e92-8154-107cff1d8e24 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.187643 Oct 27 01:20:33.452410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 123/263] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:33 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:33.552103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-31b091cf-6b75-4ddc-b5c2-e76334add7bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 25280 microversion: 2.1 time: 0.116158 Oct 27 01:20:33.552909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 141/264] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:33 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 25280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:34.445299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:34.446246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:34.452685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.453130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.454136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.454583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.472461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:34.477780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:34.484140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.484957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.486243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.486971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.568865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-17a088b7-e162-4904-9fec-03185a0df382 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 26867 microversion: 2.20 time: 0.125456 Oct 27 01:20:34.574424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 124/265] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:34 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 26867 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:34.580896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:34.582269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:34.590380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.590975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.591896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:34.592479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:34.642795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:34.650502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fc480e31-9a88-4841-87e0-095fb2960576 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.184727 Oct 27 01:20:34.652314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 142/266] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:34 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:34.715057 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0ca41363-05ef-466c-9500-4c65e45c5a34 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 26595 microversion: 2.1 time: 0.138885 Oct 27 01:20:34.719093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 125/267] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:34 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 26595 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:35.581382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:35.582334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:35.590294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.590742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.591570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.591927 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.670946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:35.671913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:35.682191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.682638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.683404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.683833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.714005 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-07142c10-a905-43ed-93cd-da5cd15dcec4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 27459 microversion: 2.20 time: 0.136172 Oct 27 01:20:35.715208 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 143/268] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:35 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 27459 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:35.725978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:35.727341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:35.736051 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.739385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.739385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:35.739385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:35.826580 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:35.847600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0bf40127-701d-4154-8048-c906ab9dbbc0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.182060 Oct 27 01:20:35.848805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 126/269] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:35 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:36.000546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-88a9d812-d251-4e0e-aa4f-1deeb5b23f31 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 27319 microversion: 2.1 time: 0.278033 Oct 27 01:20:36.002256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 144/270] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:35 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 27319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:36.726258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:36.727894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:36.736025 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:36.736946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:36.738366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:36.754722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:36.866680 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:36.868556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:36.876552 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:36.877001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:36.877810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:36.878277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:37.010629 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:37.018624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5cb3c5ed-e4e6-4c03-8a66-2c98dfa22bfe tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.156315 Oct 27 01:20:37.019182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 145/271] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:36 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:37.024413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:37.027335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:37.033157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:37.033611 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:37.034417 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:37.034851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:39.603134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e7212a9d-8939-4013-b498-2b6e5a64c344 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28071 microversion: 2.20 time: 2.880632 Oct 27 01:20:39.606717 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 127/272] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:36 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28071 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:39.611207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:39.612391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:39.621717 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:39.622247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:39.623030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:39.623493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:39.633920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-edd21313-7d59-4ea1-abd6-a6834e5534d1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 27854 microversion: 2.1 time: 2.612589 Oct 27 01:20:39.638660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 146/273] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:37 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 27854 bytes in 2616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:39.745754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:39.752868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fff1195f-d5ca-4e93-b6bc-a3439341227e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1521 microversion: 2.1 time: 0.148022 Oct 27 01:20:39.753424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 128/274] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:39 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:40.614575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:40.615578 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:40.623120 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.623567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.624333 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.624769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.645449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:40.646430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:40.653258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.653258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.653943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.654401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.755299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b2fc8caa-33d6-4510-96aa-52c0a66d41af tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28237 microversion: 2.20 time: 0.144679 Oct 27 01:20:40.759554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 147/275] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:40 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:40.770309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:40.770923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:40.780071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.781148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.782518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.782955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.794516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-88f26987-aba6-4aef-8716-a3617cded2bc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28211 microversion: 2.1 time: 0.152554 Oct 27 01:20:40.795336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 129/276] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:40 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:40.922681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:40.930170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-eb59f3b0-41af-46f6-8ef6-d958f3baf194 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1501 microversion: 2.1 time: 0.163729 Oct 27 01:20:40.930806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 148/277] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:40 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:40.945948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:40.946692 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:40.953507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.953947 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:40.954735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:40.955153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:41.108339 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:41.121027 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8951d433-8841-4edc-90d5-c995f14376bf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1515 microversion: 2.1 time: 0.178796 Oct 27 01:20:41.121824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 130/278] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:40 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:41.766602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:41.767525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:41.774516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:41.774970 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:41.775729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:41.776163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:41.807364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:41.808266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:41.814654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:41.815031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:41.815782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:41.816204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:41.902696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-412e613c-1cfa-4706-8561-53dfa8fdbce1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28237 microversion: 2.20 time: 0.139531 Oct 27 01:20:41.904773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 149/279] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:41 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:41.934428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c79b7d4c-164f-45a6-b722-9ff52f6aa1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28211 microversion: 2.1 time: 0.131361 Oct 27 01:20:41.935072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 131/280] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:41 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:42.915297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:42.916242 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:42.922838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:42.923287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:42.924057 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:42.924483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:42.948171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:42.951205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:42.968372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:42.968816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:42.969589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:42.970048 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:43.041269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-31430842-b49a-4348-bf44-f4448a8f8317 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28528 microversion: 2.20 time: 0.130215 Oct 27 01:20:43.043916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 150/281] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:42 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28528 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:43.048238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:43.049499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:43.057562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:43.058260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:43.059202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:43.059665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:43.085345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'flavor' on Instance uuid 2c00af12-ba9b-4253-8e58-985becdb2ad0 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:20:43.111383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ffe56f28-d945-414e-9a51-ab588dd605a3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28502 microversion: 2.1 time: 0.166422 Oct 27 01:20:43.111383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 132/282] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:42 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:43.503900 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-74633851-8708-4d55-811f-65d4ac0eb533 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action" status: 200 len: 32 microversion: 2.1 time: 0.460657 Oct 27 01:20:43.504672 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 151/283] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:43 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:20:43.515231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:43.515915 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:43.523819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:43.524271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:43.525029 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:43.525454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:43.661490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:43.676236 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-07d855db-0415-407a-b99d-f91a847ff57a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.164462 Oct 27 01:20:43.676853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 133/284] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:43 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:44.055170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:44.056847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:44.074066 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.074521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.075296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.075721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.122755 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:44.133171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:44.139815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.140353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.141179 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.141662 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.174523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d957723c-ab4a-462d-b798-a36a9074cc47 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28696 microversion: 2.20 time: 0.124884 Oct 27 01:20:44.175177 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 152/285] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:44 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28696 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:44.268894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3f012a11-1e1f-414e-a500-69abee33e9c5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28670 microversion: 2.1 time: 0.152221 Oct 27 01:20:44.270703 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 134/286] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:44 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:44.694443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:44.695282 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:44.702203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.702681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.703440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:44.703878 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:44.829179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:44.837070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-23ac5b91-7464-428c-867b-02a1bcbc1b6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.146747 Oct 27 01:20:44.837660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 153/287] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:44 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:45.187449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:45.188438 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:45.195415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.195857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:45.196617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.197045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:45.281116 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:45.282129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:45.288414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.289396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:45.290198 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.290633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:45.306671 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-89a5bce6-c0bb-4dae-a291-05688d202428 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28696 microversion: 2.20 time: 0.121541 Oct 27 01:20:45.310908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 135/288] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:45 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28696 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:45.385013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a004faaa-efe2-4f62-8029-ae4e73f593ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28670 microversion: 2.1 time: 0.107532 Oct 27 01:20:45.385661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 154/289] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:45 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28670 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:45.895099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:45.895099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:45.895099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.895099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:45.896083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:45.896083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:46.003959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:46.016582 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-37b9c510-34db-45f4-a3ce-9be3048b3620 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.165626 Oct 27 01:20:46.017496 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 136/290] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:45 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:46.319868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:46.321503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:46.328558 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:46.329059 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:46.329811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:46.330266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:46.397064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:46.398092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:46.404677 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:46.405121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:46.405962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:46.406441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:46.461466 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-79bc2245-2b9b-4f61-b3c8-ec0b6d671660 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28696 microversion: 2.20 time: 0.145262 Oct 27 01:20:46.462180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 155/291] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:46 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28696 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:46.523454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c2a150d4-7f5d-4e60-9751-208ba021b926 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28670 microversion: 2.1 time: 0.129951 Oct 27 01:20:46.524141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 137/292] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:46 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28670 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:47.035216 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:47.035903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:47.043504 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.043954 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.044717 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.045149 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.171860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:47.179965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5847dec9-ff49-4ddd-bf04-7e1e4f2e04b1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.148698 Oct 27 01:20:47.190907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 156/293] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:47 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:47.474166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:47.475177 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:47.482104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.482796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.483588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.484016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.535004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:47.535946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:47.542639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.543086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.543852 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:47.544281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:47.587392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c3e56a7f-eb20-424f-bb04-de36cf3852e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28696 microversion: 2.20 time: 0.115932 Oct 27 01:20:47.590486 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 138/294] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:47 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28696 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:47.649833 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3bb563dc-c221-4660-9b71-501518c7d445 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28670 microversion: 2.1 time: 0.118352 Oct 27 01:20:47.651275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 157/295] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:47 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28670 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:48.199385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:48.202443 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:48.207451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.208129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.209092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.209676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.332934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:48.341515 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-abb54405-aff5-4c4f-9ae9-d5c28eaaf2cc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.146773 Oct 27 01:20:48.342117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 139/296] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:48 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:48.599358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:48.600376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:48.607343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.608113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.608863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.609325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.661062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:48.662000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:48.668493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.668963 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.669677 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:48.670146 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:48.735249 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-de2700d8-0ffd-4856-932d-cc937877e121 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 28850 microversion: 2.20 time: 0.139823 Oct 27 01:20:48.735902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 158/297] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:48 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 28850 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:48.797877 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-54471e55-2f70-4681-ba8e-148f0ab93a0e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 28670 microversion: 2.1 time: 0.140296 Oct 27 01:20:48.798836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 140/298] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:48 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 28670 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:49.359345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:49.359936 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:49.366821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.367261 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.368016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.368442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.495348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:49.503472 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bbb8103c-4c15-4aee-b617-dfcd95cb3243 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.148719 Oct 27 01:20:49.504139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 159/299] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:49 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:49.747996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:49.749011 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:49.755873 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.756316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.757085 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.757529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.809569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:49.810513 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:49.816670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.817108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.817877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:49.818305 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:49.857077 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7e9bf2d7-6fcc-4fc8-91c4-bd10dad98691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 30341 microversion: 2.20 time: 0.112983 Oct 27 01:20:49.858489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 141/300] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:49 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 30341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:49.943587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-44d0b3d6-b47c-4c59-bb25-4ee84d2c8814 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 29641 microversion: 2.1 time: 0.137668 Oct 27 01:20:49.944235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 160/301] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:49 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 29641 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:50.520906 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:50.521586 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:50.529071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.529514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.530299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.530729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.665230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:50.672671 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d05b7de5-fd15-4576-acd4-b0698b4e464c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.155748 Oct 27 01:20:50.680423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 142/302] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:50 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:50.871173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:50.872213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:50.879086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.880574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.880574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.880901 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.955121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:50.956020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:50.962129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.962568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.963320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:50.963742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:50.993098 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dfb31880-b930-479d-99ba-9880e9cafab0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 31478 microversion: 2.20 time: 0.125564 Oct 27 01:20:50.996217 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 161/303] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:50 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 31478 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:51.068145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a3d0020f-71f7-4612-948b-b1d652d7e008 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 31065 microversion: 2.1 time: 0.116438 Oct 27 01:20:51.068872 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 143/304] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:50 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 31065 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:51.690689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:51.691378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:51.698877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:51.699267 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:51.700061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:51.700510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:51.838404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:51.846452 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-473c8079-b2ce-4a3f-a4d7-4376138e4a5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.159732 Oct 27 01:20:51.847028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 162/305] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:51 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:52.005538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:52.006695 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:52.014093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.015057 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.016312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.016879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.079979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:52.084399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:52.089098 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.089617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.090614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.091109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.135758 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-200179ef-60fa-45e1-8898-6fea646a2760 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 32695 microversion: 2.20 time: 0.134340 Oct 27 01:20:52.138173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 144/306] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:51 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 32695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:52.198821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-652aafb9-24b3-4e89-a635-95e3a6486c09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 32595 microversion: 2.1 time: 0.122473 Oct 27 01:20:52.200084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 163/307] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:52 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 32595 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:52.864123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:52.868074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:52.872697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.873148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.873905 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:52.874393 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:52.999210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:53.007956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2fbf68cf-dde9-41ed-a43d-606bbbe7c231 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.147840 Oct 27 01:20:53.008535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 145/308] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:52 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:53.148638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:53.150212 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:53.157045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:53.157491 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:53.158269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:53.158695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:53.211288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:53.212277 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:53.220316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:53.221218 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:53.222638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:53.223493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:53.282372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cf07cc88-9a05-4727-8158-49932b12879a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 33397 microversion: 2.20 time: 0.138226 Oct 27 01:20:53.283029 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 164/309] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:53 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 33397 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:53.361352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-69a34a52-9bec-432a-b4cf-da634cda7f3a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 33459 microversion: 2.1 time: 0.149947 Oct 27 01:20:53.361352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 146/310] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:53 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 33459 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:54.025058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:54.025750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:54.034675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.035167 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.035944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.036664 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.179702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:54.187267 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f082440f-9f03-420d-8521-a1b3af917c95 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.166314 Oct 27 01:20:54.187896 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 165/311] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:54 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:54.295945 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:54.297544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:54.305034 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.305679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.306609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.307042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.371048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:54.372113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:54.378501 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.378955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.379731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:54.380168 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:54.416561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-149e400f-e3dd-4055-8641-532328e0262d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 33964 microversion: 2.20 time: 0.125675 Oct 27 01:20:54.419294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 147/312] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:54 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 33964 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:54.497357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e074682d-4d0d-4841-aeac-f718e1977c51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 34096 microversion: 2.1 time: 0.130870 Oct 27 01:20:54.501486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 166/313] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:54 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 34096 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:55.205255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:55.206112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:55.226234 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.228811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.229980 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.230777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.432473 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:55.433479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:55.440556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.441003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.441766 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.442242 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.457922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:55.466004 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0be95fa0-f9ff-4877-819c-9825cf5a10d6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.264889 Oct 27 01:20:55.466614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 148/314] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:55 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:55.508712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:55.509687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:55.526436 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.527334 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.528566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:55.529168 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:55.567268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f46426c7-e8c9-4b43-801a-a459438cc12c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 34710 microversion: 2.20 time: 0.139345 Oct 27 01:20:55.569464 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 167/315] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:55 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 34710 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:55.649746 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fb233c8c-2dbe-4a31-9fb6-15c16ef52c8f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 34791 microversion: 2.1 time: 0.144585 Oct 27 01:20:55.653825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 149/316] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:55 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 34791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:20:56.483184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:56.483949 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:56.491295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.492396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.493174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.493608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.579814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:56.581483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:56.590240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.590861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.591754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.592284 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.664410 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:56.678048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-766026f1-684c-425e-a240-caa14b0f5de8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.199036 Oct 27 01:20:56.681276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 168/317] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:56 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:56.685083 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:56.685991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:56.695449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.695449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.695449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:56.695449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:56.731222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e3527789-a0ce-48b3-b825-85e055a7c67e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 35618 microversion: 2.20 time: 0.155523 Oct 27 01:20:56.731964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 150/318] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:56 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 35618 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:56.822777 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fd677b21-a6c3-441e-b4ab-62a71dd4ed01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 35486 microversion: 2.1 time: 0.141140 Oct 27 01:20:56.823616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 169/319] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:56 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 35486 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:57.702512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:57.703346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:57.709775 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.710729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.711807 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.712241 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.751147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:57.752140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:57.761055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.761721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.762552 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.763130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.849870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:57.858189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-37b38f53-2d97-46f7-9e3c-596808b21a55 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1501 microversion: 2.1 time: 0.160269 Oct 27 01:20:57.858744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 151/320] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:57 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:20:57.879266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:57.880183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:57.888728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5043e74f-61da-469b-b502-0cdd15994d9d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 36400 microversion: 2.20 time: 0.141344 Oct 27 01:20:57.889559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 170/321] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:57 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 36400 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:57.897010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa0f446-5593-40cc-89b0-42b1c2cf2d25"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:57.897010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:57.899389 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.899837 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.900606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.901033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.905561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.906270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.907241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.908184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.941150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] HTTP exception thrown: Cannot 'attach_volume' instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 while it is in vm_state rescued Oct 27 01:20:57.941974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Returning 409 to user: Cannot 'attach_volume' instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 while it is in vm_state rescued {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:20:57.943196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f1d1b5f2-b6f0-4130-9fc4-370011598725 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052075 Oct 27 01:20:57.943918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 171/322] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:20:57 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 01:20:57.953101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:57.953952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:57.961549 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.962547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:57.963668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:57.964294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:58.067125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c210442b-691a-4dac-a993-7de63e389798 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 36324 microversion: 2.1 time: 0.206987 Oct 27 01:20:58.067799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 152/323] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:57 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 36324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:58.200461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b08b473e-6a30-4194-b695-4753290f15f6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.250944 Oct 27 01:20:58.208868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 172/324] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:57 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:20:58.215590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:58.216428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:58.225405 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:58.227081 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:58.227970 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:58.228417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:58.375219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:58.383879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6f71b41f-caca-4b15-bd41-d50d176f2125 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1509 microversion: 2.1 time: 0.173627 Oct 27 01:20:58.384538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 153/325] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:58 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:20:58.903099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:58.904272 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:58.923118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:58.923118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:58.923118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:58.923118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:59.067676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-880636fb-e4af-4d70-83f3-047101503e37 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 37368 microversion: 2.20 time: 0.170273 Oct 27 01:20:59.068652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 173/326] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:20:58 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 37368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:20:59.079160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:20:59.080135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:59.086706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:59.087152 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:59.087943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:59.088366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:59.215565 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-76dc1706-f7de-4a36-81a3-2e9b52e7363d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 37249 microversion: 2.1 time: 0.139901 Oct 27 01:20:59.217051 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 154/327] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:20:59 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 37249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:20:59.401660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:20:59.402396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:20:59.409328 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:59.409771 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:59.410559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:20:59.410986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:20:59.543363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:20:59.552438 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-738d041e-b788-4439-9588-ef31698526bd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1509 microversion: 2.1 time: 0.154813 Oct 27 01:20:59.562228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 174/328] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:20:59 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:00.081310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:00.082333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:00.089629 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.090223 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.091103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.091615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.198497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9ae2518b-cca4-4fc5-ba05-723fda408025 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 38057 microversion: 2.20 time: 0.121307 Oct 27 01:21:00.199304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 155/329] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:21:00 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 38057 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:21:00.229174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:00.230156 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:00.236912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.237361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.238158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.238592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.349600 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2c5c106b-f829-4f90-a5ee-0a2c25b7b28d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 38030 microversion: 2.1 time: 0.124505 Oct 27 01:21:00.350435 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 175/330] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:00 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 38030 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:21:00.570822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:00.571624 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:00.578799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.579258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.580070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:00.580507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:00.856272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:00.864194 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0e7053bb-05dc-4a0c-bd23-016246a822ae tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1509 microversion: 2.1 time: 0.298070 Oct 27 01:21:00.864768 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 156/331] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:00 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:01.211621 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:01.212821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:01.227141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.230526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:01.230526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.230526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:01.346520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-acfd00dc-e193-4f55-948e-86a8a86ba3e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 38216 microversion: 2.20 time: 0.139383 Oct 27 01:21:01.347203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 176/332] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:21:01 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 38216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:21:01.363062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:01.365195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:01.380485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.380929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:01.381699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.382332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:01.504727 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-223aa35f-c5e2-4b68-ab62-e0a45f3bb8ed tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 38191 microversion: 2.1 time: 0.146194 Oct 27 01:21:01.505504 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 157/333] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:01 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 38191 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:21:01.884033 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:01.884782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:01.893903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.894772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:01.895860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:01.896825 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:02.372148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:02.374102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:02.397198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:02.401043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:02.402248 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:02.402992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:02.505934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:02.509008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d3b0b715-2d7f-48e4-a42f-3624e4c543dd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 38227 microversion: 2.20 time: 0.153110 Oct 27 01:21:02.509786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 158/334] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:21:02 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 38227 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:21:02.534450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a9a3d532-742c-4771-b126-4af6f9db6f6c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1515 microversion: 2.1 time: 0.654307 Oct 27 01:21:02.534947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 177/335] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:01 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:02.535551 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:02.536736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:02.545368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:02.546097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:02.547079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:02.547675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:02.667306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-84406c42-c941-439e-aa69-353084a2db6f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 38195 microversion: 2.1 time: 0.151145 Oct 27 01:21:02.673121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 159/336] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:02 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 38195 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:21:03.522303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:03.524653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:03.532039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.532532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.533464 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.534218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.633117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2f53556b-139a-4b4a-ad3b-33948f8f35c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 200 len: 38357 microversion: 2.20 time: 0.114033 Oct 27 01:21:03.638632 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 178/337] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:21:03 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 38357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:21:03.645406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:03.647964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:03.654881 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.655317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.656265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.656839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.685938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:03.686309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9c7cc2b0-c0d1-4e0a-9051-e9d203537665 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/ips" status: 200 len: 150 microversion: 2.20 time: 0.045948 Oct 27 01:21:03.687111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 160/338] 10.222.0.32 () {60 vars in 1288 bytes} [Wed Oct 27 01:21:03 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:21:03.687620 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:03.695984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.696712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.697709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.698384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.803649 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1ef69855-8cb5-45d6-b84a-e0d470983b44 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 200 len: 38322 microversion: 2.1 time: 0.125052 Oct 27 01:21:03.804976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 179/339] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:03 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 38322 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:21:03.815280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:03.816433 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:03.828502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.828952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.830606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:03.831038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:03.889431 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0acbf1d6-2bda-44c0-ace4-32d4e4413d16 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/ips" status: 200 len: 144 microversion: 2.1 time: 0.078629 Oct 27 01:21:03.910367 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 161/340] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:21:03 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/ips => generated 144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:21:04.392101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:04.393214 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:04.401215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:04.402108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:04.403097 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:04.403713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:04.548638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:04.557289 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-84361010-d7b2-4eae-a1c7-ba6b3b10ed6d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1515 microversion: 2.1 time: 0.169503 Oct 27 01:21:04.557866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 180/341] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:04 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:04.577015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d631d19-696d-44a8-afcb-56356e140bc9"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:04.578188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:04.584993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:04.585735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:04.586711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:04.587180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:05.789580 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-641259a4-f10d-446e-affb-9967899c08d0 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.216117 Oct 27 01:21:05.794142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 162/342] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:21:04 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 194 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:06.768265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:06.769406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:06.778237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:06.778904 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:06.779818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:06.780257 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:06.813040 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lazy-loading 'flavor' on Instance uuid ef2a60d0-e2da-4415-8558-1da7a803e3f4 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:21:07.537510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b8a7dd29-f0a0-4a7b-83a1-d2b80a5ccba9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 202 len: 0 microversion: 2.20 time: 0.773224 Oct 27 01:21:07.538822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 181/343] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:21:06 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:21:07.550661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:07.551989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:07.562134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:07.562134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:07.562134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:07.562531 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:07.783544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca57d6eb-55fc-44d1-8591-f2b4f4eeec5a"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:07.785284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:07.802932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:07.803651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:07.806693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:07.809149 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:07.952503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:07.973153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:07.978644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:07.979862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a86a8614-27c0-4a50-aaaa-959e9fee54e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.434499 Oct 27 01:21:07.980443 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 163/344] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:07 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:08.881296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-32298dc4-d9e3-406c-b004-b5f2c739264f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104474 Oct 27 01:21:08.884314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 182/345] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:21:07 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments => generated 194 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:09.005707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:09.006397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:09.023556 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:09.023556 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:09.024979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:09.025448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:09.591040 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:09.603166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:09.611301 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:09.612946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5a1f9d55-00b6-44a8-84db-9b8e9582da95 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.618090 Oct 27 01:21:09.613660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 164/346] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:08 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:10.636796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:10.638395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:10.644730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:10.645258 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:10.646858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:10.647962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:10.883189 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:10.890838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:10.892584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:10.893929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9fde3bf5-d2b7-4ca2-b403-0637831dee3a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.261973 Oct 27 01:21:10.894991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 183/347] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:10 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:11.918959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:11.932047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:11.942407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:11.943153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:11.944526 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:11.944612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:12.185647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:12.191457 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:12.193177 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:12.194754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-54c89850-a0b1-4f07-9f76-e07b32dcb61d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.282156 Oct 27 01:21:12.207472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 165/348] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:11 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:13.219670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:13.220892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:13.228372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:13.229257 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:13.230250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:13.230883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:13.539442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:13.548430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:13.565686 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:13.570597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-071ff34d-f1bc-40d6-b908-e6ea83d4a8b2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.355866 Oct 27 01:21:13.570597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 184/349] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:13 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:14.588436 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:14.589073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:14.602816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:14.603398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:14.604805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:14.605451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:14.730843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:14.740902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:14.743769 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:14.745280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4db7a9ad-1633-4044-a80d-1943a104d897 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.161509 Oct 27 01:21:14.746451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 166/350] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:14 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:15.764612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:15.765239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:15.775814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:15.776524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:15.777512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:15.779958 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:15.969461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:15.978413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:15.980113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:15.981359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-564359b0-7b2e-45c3-ba44-704a676078d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.220450 Oct 27 01:21:15.992516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 185/351] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:15 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:17.001033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:17.002422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:17.014598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:17.014598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:17.014598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:17.014598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:17.196401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:17.206335 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:17.209294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:17.211678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0ed92922-0e0b-4e2d-a61a-e00884296cca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.214908 Oct 27 01:21:17.212880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 167/352] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:16 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:18.248667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:18.252717 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:18.263155 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:18.263616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:18.264614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:18.265219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:18.432641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:18.441042 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:18.442890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:18.444098 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-19f02e92-5384-4d04-8e34-ba0bdd6c8cd6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.217157 Oct 27 01:21:18.444824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 186/353] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:18 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:19.463235 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:19.464242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:19.474004 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:19.474964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:19.475767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:19.476193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:19.639479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:19.656569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:19.658603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:19.666353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4401541f-c809-47b5-9d20-5dbf2d26444d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.207530 Oct 27 01:21:19.679533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 168/354] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:19 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:20.687711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:20.689060 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:20.696639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:20.710296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:20.714193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:20.714648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:20.872809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:20.881012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:20.883151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:20.884666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-36bcfe98-b514-4f7e-aa95-c3fd4e329846 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.201326 Oct 27 01:21:20.885306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 187/355] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:20 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:21.904182 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:21.905247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:21.915739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:21.916481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:21.917506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:21.918014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:22.043365 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:22.051148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:22.052739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:22.054147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-70ec8916-dbc0-4b9b-bb8e-7c19cdc33766 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1743 microversion: 2.20 time: 0.153670 Oct 27 01:21:22.054804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 169/356] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:21 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:23.079199 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:23.079908 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:23.089258 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:23.089922 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:23.091297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:23.091838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:23.253855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:23.276860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:23.276860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:23.276860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-34b5e1d8-2053-4d4e-b316-b462a48b4ad9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1743 microversion: 2.20 time: 0.202103 Oct 27 01:21:23.277414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 188/357] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:23 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:23.566556 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:23.568440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:23.577927 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:23.578753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:23.580358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:23.581140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:23.617758 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'flavor' on Instance uuid 2c00af12-ba9b-4253-8e58-985becdb2ad0 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:21:24.134120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a4b018ff-e350-4930-931b-5f62228945b4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action" status: 200 len: 32 microversion: 2.1 time: 0.573425 Oct 27 01:21:24.140286 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 170/358] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:23 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action => generated 32 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:21:24.145928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:24.146706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:24.154597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:24.155050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:24.155877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:24.156626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:24.295578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:24.296470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:24.307125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:24.307746 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:24.308743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:24.309331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:24.337489 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:24.349402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-74e86125-59b6-40cc-9f1a-c95c520fd0ba tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.208646 Oct 27 01:21:24.352223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 189/359] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:24 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:24.498483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:24.512814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:24.513150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:24.514478 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-71432a1a-6796-4cfc-828a-b41edf1b0f6b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1743 microversion: 2.20 time: 0.223261 Oct 27 01:21:24.515402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 171/360] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:24 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:25.035864 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-a304c139-dd23-4326-bbc4-88922b08fae3 req-2be82e06-5ca8-47c5-8e82-5d047dc81ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "name": "network-vif-plugged", "status": "completed", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:25.035864 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:25.035864 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:21:25.043468 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-a304c139-dd23-4326-bbc4-88922b08fae3 req-2be82e06-5ca8-47c5-8e82-5d047dc81ad5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:25.044157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-a304c139-dd23-4326-bbc4-88922b08fae3 req-2be82e06-5ca8-47c5-8e82-5d047dc81ad5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:25.057511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-a304c139-dd23-4326-bbc4-88922b08fae3 req-2be82e06-5ca8-47c5-8e82-5d047dc81ad5 service nova] Creating event network-vif-plugged:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:21:25.064652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-a304c139-dd23-4326-bbc4-88922b08fae3 req-2be82e06-5ca8-47c5-8e82-5d047dc81ad5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037786 Oct 27 01:21:25.083635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 190/361] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:25.370357 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:25.370357 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:25.376282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:25.377139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:25.377989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:25.378550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:25.517240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:25.527003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c4797e58-c30b-45c7-9d89-9a974e1f0b68 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.163316 Oct 27 01:21:25.533017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 172/362] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:25 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:25.533794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:25.534539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:25.542966 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:25.543432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:25.544334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:25.544807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:25.693620 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:25.695504 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:25.696983 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:25.698184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4b1d54d3-0698-44da-ae13-38c3b98a043c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.169123 Oct 27 01:21:25.698971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 191/363] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:25 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:26.544835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:26.545430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:26.555975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:26.556418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:26.557188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:26.557616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:26.717559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:26.719796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:26.726968 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:26.733549 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:26.736650 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:26.736943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a2643622-efc8-4a18-97db-229ad0e22fdc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.195630 Oct 27 01:21:26.739951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:26.740642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:26.748725 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 173/364] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:26 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:26.904781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:26.923500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:26.924435 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:26.926242 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-24decdcb-56b0-457a-9aed-8d3569c760fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.212763 Oct 27 01:21:26.934832 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 192/365] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:26 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:27.283099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'create', calling method: .version_select at 0x7f1d36d07dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1788751962"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:27.344058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for project 5e37607855ec49b6af8f28274acba57b. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:21:27.358422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for user d9f2d198479f41a5aede9109c9ae90a9 and project 5e37607855ec49b6af8f28274acba57b. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:21:27.686282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for project 5e37607855ec49b6af8f28274acba57b. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:21:27.696108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for user d9f2d198479f41a5aede9109c9ae90a9 and project 5e37607855ec49b6af8f28274acba57b. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:21:27.732092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ccbc180a-a36a-4989-8e82-76148ff8c8a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.443633 Oct 27 01:21:27.732092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 174/366] 10.222.0.32 () {60 vars in 1157 bytes} [Wed Oct 27 01:21:27 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:27.758492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:27.759753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:27.768756 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:27.772271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:27.773637 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:27.775694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:27.911323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-665589911", "imageRef": "cddb84b4-27c2-465e-bf8a-08970fd98c8e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1788751962", "networks": [{"uuid": "9a4571fc-d7ab-424a-af9f-0f896f2dad41"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:27.967920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:27.981477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2177faae-1624-4461-8821-b2996e1eb228 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.229712 Oct 27 01:21:27.987497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 193/367] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:27 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:28.001249 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:28.008981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:28.018599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] validate_networks() for [('9a4571fc-d7ab-424a-af9f-0f896f2dad41', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:21:28.024499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:28.025646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:28.038790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:28.039425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:28.279036 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:28.286322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:28.290778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:28.294887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-55634daa-3a2c-46da-bf4b-d7a61f1de936 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.304453 Oct 27 01:21:28.295517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 194/368] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:27 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:28.609787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:21:28.610233 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:21:28.612568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:21:28.612994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:21:28.613402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:21:28.625638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:28.626844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:28.628093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:28.628810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:28.654484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for project 5e37607855ec49b6af8f28274acba57b. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:21:28.659147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Getting quotas for user d9f2d198479f41a5aede9109c9ae90a9 and project 5e37607855ec49b6af8f28274acba57b. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:21:28.672971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:21:28.676391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cddb84b4-27c2-465e-bf8a-08970fd98c8e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:21:28.839568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-060af5f8-43a1-48d4-9bc4-422cf817c0a9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935143 Oct 27 01:21:28.840890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 175/369] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:21:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:21:28.858462 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-175691d4-b7ba-47ed-a2ae-33c9528728c2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:28.859095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-175691d4-b7ba-47ed-a2ae-33c9528728c2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:28.956639 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-175691d4-b7ba-47ed-a2ae-33c9528728c2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:28.965302 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-175691d4-b7ba-47ed-a2ae-33c9528728c2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1258 microversion: 2.1 time: 0.116579 Oct 27 01:21:28.966359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 195/370] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:28 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1258 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:29.006346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:29.007381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:29.020528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:29.021228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:29.023295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:29.024141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:29.203658 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:29.217149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f6671231-73b0-4bc5-9b26-3491ca395983 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.214413 Oct 27 01:21:29.217647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 176/371] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:29 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:29.316585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:29.316585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:29.323118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:29.323793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:29.325218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:29.326497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:29.538860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:29.549762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:29.551726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:29.553430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b3168c6c-1e81-4259-a9f5-59a2ad5a8c4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.243558 Oct 27 01:21:29.555772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 196/372] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:29 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:29.982686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-39edce32-723f-44bd-96d5-0b859893420f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:29.983295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-39edce32-723f-44bd-96d5-0b859893420f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:30.118660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39edce32-723f-44bd-96d5-0b859893420f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:30.118660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-39edce32-723f-44bd-96d5-0b859893420f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1258 microversion: 2.1 time: 0.074601 Oct 27 01:21:30.118660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 177/373] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:29 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:30.234388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:30.235731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:30.242526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:30.242969 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:30.243731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:30.244164 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:30.380378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:30.394436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f018c6dc-c35a-4dac-9bc2-4bd43e9adcd4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.163949 Oct 27 01:21:30.394997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 197/374] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:30 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:30.573216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:30.573844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:30.579742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:30.580206 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:30.581017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:30.581479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:30.701059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:30.708622 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:30.710154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:30.711301 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8e79227e-247d-43ab-9407-1fd68084ab69 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.141746 Oct 27 01:21:30.712472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 178/375] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:30 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:31.105668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-67af4c10-ad65-48b4-9d8f-847e134dc354 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:31.105879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-67af4c10-ad65-48b4-9d8f-847e134dc354 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:31.160480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-67af4c10-ad65-48b4-9d8f-847e134dc354 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:31.173067 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-67af4c10-ad65-48b4-9d8f-847e134dc354 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1258 microversion: 2.1 time: 0.071539 Oct 27 01:21:31.178907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 198/376] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:31 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:31.414980 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:31.416387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:31.425603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:31.437135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:31.437135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:31.437135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:31.624607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:31.653011 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9fcf44de-d47b-4774-8875-fbea3acb6edd tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.243205 Oct 27 01:21:31.665836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 179/377] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:31 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:31.733650 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:31.735536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:31.742538 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:31.743260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:31.744260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:31.745092 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:31.926615 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:31.942543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:31.947292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:31.948712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c8b6bf03-5b04-4915-b5d3-b52f5a975576 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.221481 Oct 27 01:21:31.959034 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 199/378] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:31 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:32.190663 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:32.191597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:32.198305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.199106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:32.207264 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.207264 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:32.279138 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:32.285312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b7ee770b-945c-4004-9d0d-d9cd2a966be7 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1262 microversion: 2.1 time: 0.098920 Oct 27 01:21:32.285888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 180/379] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:32 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:32.670311 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:32.670959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:32.677382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.677767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:32.678737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.679194 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:32.832720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:32.841752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-27fa5f11-8a97-4eca-93e5-fdfcfc8634dc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.175625 Oct 27 01:21:32.842606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 200/380] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:32 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:32.971422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:32.972016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:32.979488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.980168 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:32.981080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:32.981900 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.223999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1bd99791-e711-4510-b2bf-0e5a76869ebd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:33.233693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bd99791-e711-4510-b2bf-0e5a76869ebd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.233875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:33.236479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bd99791-e711-4510-b2bf-0e5a76869ebd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.246887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:33.249204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:33.252229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b8db3b9a-cdcf-4ac7-8ba2-14d5bd62e6da tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.287144 Oct 27 01:21:33.258451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 181/381] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:32 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:33.305102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:33.306267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:33.312823 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.313549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.314516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.315118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.330143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1bd99791-e711-4510-b2bf-0e5a76869ebd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Going to try to stop instance {{(pid=116349) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 01:21:33.383897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:33.391599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-19c08fe5-0afa-44bd-92ae-07c3f7ce5210 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1310 microversion: 2.1 time: 0.091285 Oct 27 01:21:33.392534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 182/382] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:33 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:33.589697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1bd99791-e711-4510-b2bf-0e5a76869ebd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 202 len: 0 microversion: 2.1 time: 0.371535 Oct 27 01:21:33.590490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 201/383] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:33 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:21:33.598611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:33.599618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:33.606382 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.607166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.608028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.608532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.757885 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:33.770708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-54892903-9a6a-417d-99ad-54bcd50ae9dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.175151 Oct 27 01:21:33.772817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 183/384] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:33 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:33.860609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:33.861303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:33.874830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.874830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:33.874830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:33.874830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.011794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.020233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d153b52f-6397-46bd-b6b1-1053a98b3135 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.163876 Oct 27 01:21:34.021018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 202/385] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:33 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:34.270796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:34.271332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:34.277577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.278018 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.278800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.279226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.405875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.409250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:34.409848 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:34.414865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.416547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.416659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.416758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.417287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.417649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-91d70ec7-856c-4ff8-a352-49874f8753d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.150642 Oct 27 01:21:34.417765 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.418243 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 184/386] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:34 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:34.479599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.487539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d1d684b6-48f0-4853-9e49-898f45367325 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1318 microversion: 2.1 time: 0.081853 Oct 27 01:21:34.488105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 203/387] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:34 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:34.791810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:34.792520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:34.802045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.804133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.805304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:34.805435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:34.986085 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:34.996149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f08694f0-c318-42fa-b4cc-07cd9fa1644f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.210193 Oct 27 01:21:34.997711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 185/388] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:34 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:35.038543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:35.040310 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:35.071733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.073013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.074261 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.075745 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.328228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:35.347660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e60f740b-a042-47dd-91e4-a9ad5483c622 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.314663 Oct 27 01:21:35.348584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 204/389] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:35 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:35.439392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:35.441279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:35.464389 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.466059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.468684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.469347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.507024 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:35.507736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:35.524702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.527423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.532492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:35.533015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:35.772616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:35.783685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:35.788081 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:35.791638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-33b0f52d-f69f-4dff-8473-bb208a951482 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.358141 Oct 27 01:21:35.794003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 186/390] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:35 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:35.915163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:35.926297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-08f803c1-83a7-4255-be63-5b1acda9ca88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.424105 Oct 27 01:21:35.931666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 205/391] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:35 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:36.016741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:36.017354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:36.029729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.030258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.031171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.031752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.276569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:36.293708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2ff56ef1-c936-4cba-89b9-96b2c641d45c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.280656 Oct 27 01:21:36.294349 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 187/392] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:36 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:36.367332 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:36.368570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:36.383849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.385965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.387251 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.388862 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.678695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:36.704698 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1f41854b-00fc-4445-8961-d9acf8e8134b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.342154 Oct 27 01:21:36.709125 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 206/393] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:36 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:36.811113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:36.812419 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:36.823998 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.826822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.828080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.835423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:36.952486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:36.958255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:36.992593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:36.995126 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.002061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.004559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.233819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:37.248994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:37.252412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:37.255332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ccb74a56-fe6f-4159-a59c-17055143ee2d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.448151 Oct 27 01:21:37.258244 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 188/394] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:36 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:37.280166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-302aa5e5-a7c8-412d-adba-f348586f91ed req-5c618b65-3a4c-45cb-9a0d-d1e88ae58f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:37.294618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:37.294618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:21:37.317587 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-302aa5e5-a7c8-412d-adba-f348586f91ed req-5c618b65-3a4c-45cb-9a0d-d1e88ae58f6c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.318049 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-302aa5e5-a7c8-412d-adba-f348586f91ed req-5c618b65-3a4c-45cb-9a0d-d1e88ae58f6c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.347569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-302aa5e5-a7c8-412d-adba-f348586f91ed req-5c618b65-3a4c-45cb-9a0d-d1e88ae58f6c service nova] Creating event network-changed:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:21:37.378764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-302aa5e5-a7c8-412d-adba-f348586f91ed req-5c618b65-3a4c-45cb-9a0d-d1e88ae58f6c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100356 Oct 27 01:21:37.390612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 189/395] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:21:37.404506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:37.405275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:37.425418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.425863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.430859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.431534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.433551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:37.446850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a9fc3c3e-20bf-4985-9ed0-f52f776c81b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.503134 Oct 27 01:21:37.457519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 207/396] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:36 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:37.694502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:37.708936 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c04d5b16-0c71-409e-8de0-268fc1ae540b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.316563 Oct 27 01:21:37.723149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 190/397] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:37 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:37.725245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:37.726453 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:37.735716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.742528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:37.742528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:37.742528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.277053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:38.278395 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:38.290219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.298690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.299925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.304379 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.620488 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:38.653977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f3c50ecd-2106-4846-8be2-4f740c5c08aa tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.932299 Oct 27 01:21:38.674120 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 208/398] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:37 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:38.686359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:38.687322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:38.703737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.704549 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.705601 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.706228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.721887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:38.770254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:38.772394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:38.773678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0e02d23e-5b0e-4985-8bf9-5408b0a86657 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.501868 Oct 27 01:21:38.778722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 191/399] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:38 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:38.795296 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:38.796045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:38.809801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.813745 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.814667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:38.815150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:38.964876 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:38.974440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3dc189e2-c44b-4cd1-946f-309475b79938 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.297964 Oct 27 01:21:38.975399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 209/400] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:38 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:39.025247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:39.036063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-77be8162-9df2-444a-8022-9ebb1a1edc3b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.252050 Oct 27 01:21:39.038289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 192/401] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:38 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:39.678266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:39.678874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:39.685120 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:39.685557 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:39.686339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:39.686761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:39.796817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:39.800039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:39.804540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:39.804979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:39.805734 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:39.806186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:39.813851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:39.821888 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-69bbd58d-2c1f-4de9-9df1-2c223d40f293 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.147314 Oct 27 01:21:39.822719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 210/402] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:39 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:39.976188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:39.988123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:39.989838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:39.992037 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6eb4594a-5500-4254-be56-2ce8257ae269 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.198665 Oct 27 01:21:39.992913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 193/403] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:39 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:39.995714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:39.996569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:40.003909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.004630 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.005852 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.006635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.054470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:40.055299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:40.062503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.062934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.064022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.064519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.236007 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:40.246288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-477791de-3abd-4774-be38-f1e098a15b13 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.258163 Oct 27 01:21:40.246880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 211/404] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:39 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:40.313643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:40.323485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-07e6d03e-0c18-4ec5-bc7d-20d54f9e7804 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.273544 Oct 27 01:21:40.324364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 194/405] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:40 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:40.839100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:40.839818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:40.845434 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.845877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.846695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:40.847130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:40.972255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:40.980358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-44722db7-2506-4c3f-8c06-9993e0c05434 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.145018 Oct 27 01:21:40.980928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 212/406] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:40 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:41.014233 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:41.014849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:41.021165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.022262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.023358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.023795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.158697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:41.165285 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:41.175916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:41.177176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f917d265-ba70-450d-95df-6eff487e168a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.166774 Oct 27 01:21:41.177771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 195/407] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:41 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:41.264829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:41.265384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:41.273369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.273836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.274594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.275026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.341372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:41.344878 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:41.347835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.350185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.351581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:41.352205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:41.428583 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:41.436254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-41f32086-b14c-4220-9327-251a955f811c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.175090 Oct 27 01:21:41.442804 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 213/408] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:41 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:41.493951 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:41.501870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4b3c403e-1d6f-4b1e-b757-464a4b4d610b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.164290 Oct 27 01:21:41.502466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 196/409] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:41 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:41.997371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:41.997971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:42.004688 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.006105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.007278 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.007885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.147827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.159544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-857ffad9-79af-487b-ae20-5f7ab688f44f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.165988 Oct 27 01:21:42.163314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 214/410] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:41 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:42.196664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:42.198678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:42.206380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.207163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.208744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.209973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.354673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.363321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.364825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.366522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-48bc0e83-dc56-4d1f-a2ef-0706e4dca741 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.174204 Oct 27 01:21:42.367091 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 197/411] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:42 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:42.453088 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:42.453696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:42.460320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.460828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.461615 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.462066 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.518801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:42.519574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:42.526220 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.526665 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.527428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:42.527864 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:42.618625 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.630253 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7796a6e8-3040-46d3-9302-e028f781b8a5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.180646 Oct 27 01:21:42.631047 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 215/412] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:42 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:42.699238 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:42.707360 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-287a91ac-6eb4-4cc1-8d55-ce3f69e8ab6e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.192079 Oct 27 01:21:42.707866 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 198/413] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:42 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:43.176962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:43.177648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:43.184047 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.184492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.185260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.185690 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.317692 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.327435 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fa57e8c9-82b3-46b6-a0f7-fb55217750fb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.154245 Oct 27 01:21:43.328017 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 216/414] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:43 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:43.389041 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:43.389540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:43.395887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.396331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.398138 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.398703 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.524783 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.534516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.539754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.541998 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7cf4c5e8-b71e-4de8-a75e-f97699451653 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.160165 Oct 27 01:21:43.542686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 199/415] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:43 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:43.650894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:43.651794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:43.657682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.663073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.663073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.663073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.724938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:43.725988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:43.732833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.733271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.734065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:43.734593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:43.839393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.847760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3a681350-7688-47a4-8731-a8fa50fcb88c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.202205 Oct 27 01:21:43.856718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 217/416] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:43 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:43.903443 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:43.911788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f10934f7-6ba9-43f9-b32c-c98c50736647 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.191135 Oct 27 01:21:43.914062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 200/417] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:43 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:44.346249 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:44.347730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:44.354770 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.355483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.356682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.357274 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.494067 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:44.502399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7f7015d9-0ffc-4cec-b1e6-ef7f9f915bb6 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.160845 Oct 27 01:21:44.502980 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 218/418] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:44 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:44.562246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:44.563202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:44.570079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.570533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.571304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.571751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.719890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:44.729009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:44.730524 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:44.731923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-18df7044-8ff0-4e3f-9a11-f2fa2477bc14 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.173905 Oct 27 01:21:44.732473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 201/419] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:44 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:44.865665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:44.866785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:44.873260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.873884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.875428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.876030 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.930018 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:44.930572 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:44.936939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.937390 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:44.938311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:44.938829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:45.059891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.067172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-be816afe-02ab-469c-b2ed-1457cfb9fe6e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.206084 Oct 27 01:21:45.067591 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 219/420] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:44 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:45.106173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.115679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-49217a1e-0094-4681-8e59-6f1cc33b9065 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.189072 Oct 27 01:21:45.121630 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 202/421] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:44 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:45.526128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:45.537979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:45.537979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:45.537979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:45.537979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:45.538411 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:45.681398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.689627 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-894ad142-a622-4ea7-828c-404688ecb14d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.167277 Oct 27 01:21:45.690258 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 220/422] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:45 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:45.751608 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:45.752518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:45.760076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:45.760544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:45.761319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:45.761751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:45.897822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.906337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.907852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:45.909001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a7e555b6-b456-4b97-b0bf-bfe7b10738bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.162287 Oct 27 01:21:45.909554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 203/423] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:45 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:46.085829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:46.086491 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:46.092607 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.094881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.094881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.094881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.144117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:46.144719 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:46.153331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.153770 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.154563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.159502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.299347 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:46.311868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9bc792dc-b1e6-4a5e-b69a-231960e4407c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.231018 Oct 27 01:21:46.322207 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 221/424] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:46 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:46.556272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:46.556272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-79be1899-aaf1-445a-b227-9e6cd6a7cdc4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.240008 Oct 27 01:21:46.556272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 204/425] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:46 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:46.707128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:46.707729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:46.714775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.715221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.715986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.716414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.856806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:46.864418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0ffb4fe2-be3a-411a-a186-6fdc2dbb19b8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.160881 Oct 27 01:21:46.864980 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 222/426] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:46 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:46.929100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:46.930497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:46.937837 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.938336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:46.939233 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:46.939670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.072605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:47.089935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:47.091440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:47.092599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c8ef9bc3-cbc7-4a4e-98e3-72e05e2abdd7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.167899 Oct 27 01:21:47.097367 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 205/427] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:46 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:47.329598 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:47.330303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:47.337416 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.337862 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.338689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.339298 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.397390 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:47.399107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:47.407483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.408926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.409930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.410591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.503669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:47.514558 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5492c0d0-f46d-4251-b44a-373eca171df0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.188332 Oct 27 01:21:47.515977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 223/428] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:47 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:47.563002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:47.572108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fa48e8e0-2710-4698-b9a4-04bbbf0d1874 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.178840 Oct 27 01:21:47.582687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 206/429] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:47 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:47.882331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:47.882898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:47.889011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.889684 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:47.890478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:47.890905 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.023420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.031330 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9905bac8-f0f3-4350-8444-cb23b83afd29 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.152825 Oct 27 01:21:48.032113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 224/430] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:47 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:48.118326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:48.120279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:48.133150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.133907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.135414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.136154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.264930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.272906 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.274416 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.279806 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6c839e90-fc59-4e21-ab3c-d83c7138135f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.164122 Oct 27 01:21:48.279806 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 207/431] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:48 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:48.532145 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:48.532734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:48.540589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.541108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.541953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.542487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.590163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:48.590763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:48.596391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.596836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.597580 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:48.598046 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:48.723583 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.733234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3409147f-c38a-4126-8f7a-d9deccbad312 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.204805 Oct 27 01:21:48.733892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 225/432] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:48 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:48.780346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:48.788228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bc5bbc5d-dca8-4841-a74b-0abff8a033cd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.201575 Oct 27 01:21:48.788712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 208/433] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:48 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:49.048867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:49.049410 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:49.056160 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.056641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.057406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.057842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.181962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:49.191026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2edb5222-7046-4a3d-9401-87af3e3e1e72 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.145759 Oct 27 01:21:49.191920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 226/434] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:49 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:49.298265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:49.299720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:49.306767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.307597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.308551 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.309263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.443271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:49.451136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:49.452614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:49.453763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c4bea1d3-addf-4bf2-93c3-453921aa22e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.159546 Oct 27 01:21:49.454354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 209/435] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:49 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:49.749849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:49.750496 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:49.756551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.763838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.763838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.763838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.805539 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:49.806165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:49.812243 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.812683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.813458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:49.813882 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:49.925863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:49.935911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-151242bb-544c-406a-a1cc-cb93b46726b5 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.189685 Oct 27 01:21:49.936497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 227/436] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:49 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:49.993612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:50.001550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-59e5f043-1530-455e-a0b9-244a536af289 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.199661 Oct 27 01:21:50.002460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 210/437] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:49 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:50.210163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:50.210808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:50.217110 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.219252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:50.219252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.219252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:50.355247 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:50.363350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-93b98fef-a54f-4729-9abe-58f7f40a2a5c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.157336 Oct 27 01:21:50.363932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 228/438] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:50 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:50.470939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:50.471592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:50.477800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.478282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:50.479036 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.479498 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:50.602084 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:50.610732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:50.612275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:50.613415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-60979367-fb18-4cc7-b748-b0ecea9fe82b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.146141 Oct 27 01:21:50.613976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 211/439] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:50 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:50.952512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:50.953233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:50.959991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.960468 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:50.961252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:50.961682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.019400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:51.020368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:51.027510 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.028225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.029102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.029776 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.118706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.125719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-83e91959-69a2-45b9-858d-31fa2f98a173 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.176944 Oct 27 01:21:51.126544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 229/440] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:50 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:51.177325 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.185828 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-34eddadd-0298-422f-83f9-c37d0ca22e19 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.170142 Oct 27 01:21:51.186434 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 212/441] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:51 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:51.380750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:51.382124 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:51.388635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.389073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.389827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.390290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.510617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.518196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dd1610e0-7258-4143-a285-2b0daf4aa59e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.141256 Oct 27 01:21:51.518772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 230/442] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:51 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:51.631625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:51.632142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:51.638679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.639198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.639976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:51.640407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:51.792077 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.799678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.801163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:51.802509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-734addd4-4303-4c61-95bf-3292adbebec1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.174670 Oct 27 01:21:51.803070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 213/443] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:51 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:52.142861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:52.143486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:52.149320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.149760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.150537 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.150961 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.203798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:52.204711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:52.211063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.211604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.212473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.213184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.308287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.316085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-219b7a88-b796-4b4d-9bc6-73419e72c4ec tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.176851 Oct 27 01:21:52.316870 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 231/444] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:52 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:52.361275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.369618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-97e0698b-6100-422b-8dc1-b97b7df2ea0a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.170073 Oct 27 01:21:52.370223 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 214/445] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:52 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:52.533977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:52.534691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:52.541858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.542336 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.543093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.543519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.664022 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.671621 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-66c98238-a3e8-40cb-b3e2-89bd3c024609 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.141376 Oct 27 01:21:52.672181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 232/446] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:52 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:52.820401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:52.821049 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:52.827373 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.829742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.829742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:52.829742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:52.953559 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.961579 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.963117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:52.964274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-708220d8-45c3-4ce0-92c0-ec8070c1d8ee tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.147629 Oct 27 01:21:52.964832 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 215/447] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:52 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:53.332309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:53.332912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:53.339357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.339803 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.340576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.340986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.386720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:53.387418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:53.393133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.393643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.394486 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.394996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.491588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:53.499138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-307568ec-4a2d-4779-918c-352d7087b19d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.170390 Oct 27 01:21:53.499711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 233/448] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:53 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:53.542378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:53.550181 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6385c71d-815d-4349-b57a-3efd95a15941 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1723 microversion: 2.1 time: 0.167141 Oct 27 01:21:53.550751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 216/449] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:53 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:53.688537 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:53.689210 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:53.696493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.696946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.697700 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.698151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.819436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:53.827270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6d7ded1a-1bd3-4dfc-826b-b9899af1526c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.142570 Oct 27 01:21:53.827845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 234/450] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:53 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:53.988326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:53.988326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:53.989798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.990308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:53.991478 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:53.991912 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.125199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:54.133686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:54.135200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:54.136344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4b064732-0845-4df4-a718-02d83c93a966 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1738 microversion: 2.20 time: 0.157404 Oct 27 01:21:54.136958 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 217/451] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:53 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:54.515827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:54.516429 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:54.522205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.522731 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.523492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.523921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.567937 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:54.568569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:54.574970 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.575420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.576188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.576618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.680550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:54.688574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-988f72f1-f04c-4927-b119-3f7b0e1dd88d tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.176367 Oct 27 01:21:54.691524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 235/452] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:54 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:54.737303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:54.746270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-737db1d6-9830-4015-ba1c-2650bed0d2f6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1700 microversion: 2.1 time: 0.182013 Oct 27 01:21:54.746893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 218/453] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:54 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1700 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:54.762612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0375e295-861d-45ab-a8a5-decaf60ecc86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:54.769037 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0375e295-861d-45ab-a8a5-decaf60ecc86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.769442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0375e295-861d-45ab-a8a5-decaf60ecc86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.796057 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0375e295-861d-45ab-a8a5-decaf60ecc86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Going to try to start instance {{(pid=116349) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 01:21:54.844361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:54.844957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:54.851992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.852443 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.853216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:54.853798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:54.986133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.006431 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6d932c78-2e4f-42b1-a27c-fd04a738da5e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.165400 Oct 27 01:21:55.007353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 219/454] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:54 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:55.019222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0375e295-861d-45ab-a8a5-decaf60ecc86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 202 len: 0 microversion: 2.1 time: 0.259861 Oct 27 01:21:55.019850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 236/455] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:54 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:21:55.029400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:55.030601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:55.046468 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.046753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.047513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.047938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.156536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:55.162789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:55.174531 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.175078 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.176125 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.176753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.380877 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.403590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-00a01c5c-08bf-4990-b001-132a37974907 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1709 microversion: 2.1 time: 0.378798 Oct 27 01:21:55.404186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 220/456] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:55 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1709 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:55.420103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-5cb41cbc-462a-4407-a52e-87e0c61ee7c6 req-e5f1adf1-85e3-4aae-a86f-1363ed248091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:55.428386 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:55.428386 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:21:55.430251 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5cb41cbc-462a-4407-a52e-87e0c61ee7c6 req-e5f1adf1-85e3-4aae-a86f-1363ed248091 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.430868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5cb41cbc-462a-4407-a52e-87e0c61ee7c6 req-e5f1adf1-85e3-4aae-a86f-1363ed248091 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.445167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-5cb41cbc-462a-4407-a52e-87e0c61ee7c6 req-e5f1adf1-85e3-4aae-a86f-1363ed248091 service nova] Creating event network-vif-unplugged:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:21:55.450090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.451672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-5cb41cbc-462a-4407-a52e-87e0c61ee7c6 req-e5f1adf1-85e3-4aae-a86f-1363ed248091 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035887 Oct 27 01:21:55.452761 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 221/457] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:21:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:55.459928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.461495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.462767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-aa2917dd-93ce-4c3d-9771-907d371e095e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1720 microversion: 2.20 time: 0.311043 Oct 27 01:21:55.463383 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 237/458] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:55 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:21:55.706611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:55.707295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:55.714449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.714926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.720967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:55.720967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:55.856625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:55.864211 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-134e4132-e9d8-4977-808a-c334dbdef250 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.162051 Oct 27 01:21:55.864783 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 222/459] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:55 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:56.025162 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.036570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:56.036570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.036570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.036570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.037418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.177527 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:56.186061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a8ff8520-effa-42fc-9231-e782e14196ee tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1567 microversion: 2.1 time: 0.166112 Oct 27 01:21:56.186638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 238/460] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:56 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:56.425579 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.426238 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:56.432652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.433096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.433856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.434317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.482304 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.483103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:56.495212 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.495664 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.496506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.496967 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.612449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:56.622783 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b7faea67-4970-4924-874a-d8442d665711 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1709 microversion: 2.1 time: 0.200706 Oct 27 01:21:56.623376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 223/461] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:56 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1709 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:56.666418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:56.674309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:56.675849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:56.676943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e3fc1744-8908-409a-a6c5-d0645adadf6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1720 microversion: 2.20 time: 0.198843 Oct 27 01:21:56.677893 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 239/462] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:56 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:56.881074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.882054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:56.888297 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.888753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:56.889508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:56.889939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.015079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.023247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9c4b7844-2fc2-4f1f-9c17-b1eba1da0bc4 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.146332 Oct 27 01:21:57.023825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 224/463] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:56 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:57.203808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:57.205074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.211873 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.212319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.213097 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.213539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.359648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.368810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9110f019-5079-4bd6-94ff-fa477674580e tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1547 microversion: 2.1 time: 0.168918 Oct 27 01:21:57.369395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 240/464] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:57 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:57.386690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:57.387420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.393630 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.400082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.400082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.400082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.577108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] HTTP exception thrown: Cannot 'detach_volume' instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 while it is in vm_state rescued Oct 27 01:21:57.577827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Returning 409 to user: Cannot 'detach_volume' instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 while it is in vm_state rescued {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:21:57.578722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1196213a-76de-4772-900d-97f7f27dec13 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments/0d631d19-696d-44a8-afcb-56356e140bc9" status: 409 len: 152 microversion: 2.1 time: 0.196911 Oct 27 01:21:57.579825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 225/465] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:21:57 2021] DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments/0d631d19-696d-44a8-afcb-56356e140bc9 => generated 152 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 01:21:57.589352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:57.589978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.596162 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.596701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.597568 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.598086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.644286 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:57.645130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.652850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.653386 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.654256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.654691 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.777698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.785394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c71aa1ed-3871-40df-b701-84e070cb60dd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1713 microversion: 2.1 time: 0.145036 Oct 27 01:21:57.785955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 226/466] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:57 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1713 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:57.791206 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:57.791804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.798249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.798716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.799463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.800120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.843239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-95560021-7fe5-4fff-be2b-363c66bdddb5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action" status: 202 len: 0 microversion: 2.1 time: 0.259015 Oct 27 01:21:57.847949 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 241/467] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:21:57 2021] POST /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:21:57.853497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:57.854223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:57.861500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.861955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.863422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:57.863864 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:57.967149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.992176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.993815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:57.995047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-90480b18-2a59-438e-8f41-e0fcd38e9423 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1720 microversion: 2.20 time: 0.208163 Oct 27 01:21:57.995912 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 227/468] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:57 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:58.020295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:58.028427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-79197938-fede-4f33-9280-2a3c3aee81a4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1555 microversion: 2.1 time: 0.179630 Oct 27 01:21:58.028920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 242/469] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:57 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:58.039176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:58.042830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:58.045810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:58.046294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:58.047053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:58.047483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:58.196472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:58.204904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d1df38bf-77f3-4731-9dfe-002462ad6b8f tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.169345 Oct 27 01:21:58.215144 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 228/470] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:58 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:59.018521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:59.019184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:59.025749 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.026356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.027369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.027872 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.045648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:59.046292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:59.053030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.053759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.054768 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.055201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.215327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:59.224667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:59.227140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:59.228339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-41a16434-2cfe-4d5d-a41a-bd032c8a3066 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1663 microversion: 2.20 time: 0.214206 Oct 27 01:21:59.228644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:59.236982 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-42c9758b-bfcf-418d-a98b-eae482591d22 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1555 microversion: 2.1 time: 0.194862 Oct 27 01:21:59.237964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 229/471] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:59 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:59.238508 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 243/472] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:21:59 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1663 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:21:59.242648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:59.243300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:59.249481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.249940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.250736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.251167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.258510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "227acafa-6d7f-4348-936c-771cbb8ad403"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:59.260086 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:21:59.266242 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.266883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.268341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.268341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.405175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:21:59.423607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-877d07da-88bc-4d12-84b7-d3fef203734a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.173725 Oct 27 01:21:59.423607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 230/473] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:21:59 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:21:59.423607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-7543ad79-e035-48dd-9baa-bc022d2e32db req-a885e4a9-a2e2-4670-b2de-12b2a0c0dae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "name": "network-vif-plugged", "status": "completed", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:21:59.423607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:59.423607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:21:59.426172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7543ad79-e035-48dd-9baa-bc022d2e32db req-a885e4a9-a2e2-4670-b2de-12b2a0c0dae9 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:21:59.426605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7543ad79-e035-48dd-9baa-bc022d2e32db req-a885e4a9-a2e2-4670-b2de-12b2a0c0dae9 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:21:59.437418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-7543ad79-e035-48dd-9baa-bc022d2e32db req-a885e4a9-a2e2-4670-b2de-12b2a0c0dae9 service nova] Creating event network-vif-plugged:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:21:59.442302 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-7543ad79-e035-48dd-9baa-bc022d2e32db req-a885e4a9-a2e2-4670-b2de-12b2a0c0dae9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027625 Oct 27 01:21:59.442888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 231/474] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:21:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:00.259054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:00.259704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:00.266012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.266496 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:00.267245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.267674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:00.389496 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:00.397841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0b649177-84a2-474b-a940-0fac755d88fc tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1555 microversion: 2.1 time: 0.143301 Oct 27 01:22:00.398449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 232/475] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:00 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:00.428777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:00.429379 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:00.434974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.440256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:00.440256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.440256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:00.554855 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:00.561961 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-82668869-ce09-4b21-a585-5108e3cf1b54 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.136876 Oct 27 01:22:00.562541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 233/476] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:00 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:00.593333 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a70dd0dc-9032-41e8-936d-b34f058168d2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.340425 Oct 27 01:22:00.593964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 244/477] 10.222.0.32 () {62 vars in 1363 bytes} [Wed Oct 27 01:21:59 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments => generated 188 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:22:00.705261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:00.705961 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:00.712694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.713134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:00.713888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:00.714347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.049044 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bb182ba5-1ce4-4ec0-ac6d-65611cc327ae tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action" status: 202 len: 0 microversion: 2.20 time: 0.347361 Oct 27 01:22:01.049585 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 234/478] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:22:00 2021] POST /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:22:01.058094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:01.058719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:01.065122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.065559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.066357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.066785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.188447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:01.196499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:01.198004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:01.199175 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-38f4861f-d287-4345-bedd-4dcee6f1e5a2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1749 microversion: 2.20 time: 0.144793 Oct 27 01:22:01.199727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 245/479] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:01 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1749 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:01.415193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:01.415790 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:01.421736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.422225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.422988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.423417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.547615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:01.555434 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-66628a48-07a7-4a08-9fb9-f866ed91ecf2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1555 microversion: 2.1 time: 0.145130 Oct 27 01:22:01.555997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 235/480] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:01 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:01.579039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:01.579565 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:01.585844 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.586359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.592644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:01.592644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:01.708319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:01.717975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d09998bc-353d-4b2c-b6f9-1484d6b5c72a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.142635 Oct 27 01:22:01.728327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 246/481] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:01 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:02.218091 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:02.218693 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:02.225342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.225530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.226316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.226836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.349543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:02.358104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:02.359574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:02.360706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-584ad467-3642-4ddc-a34e-65c2c5cb4239 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1749 microversion: 2.20 time: 0.146317 Oct 27 01:22:02.361290 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 236/482] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:02 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1749 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:02.572174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:02.572776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:02.579466 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.579909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.580663 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.581094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.701683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:02.709399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-eeb7c8a7-9d34-4be2-8081-20ca8fc7e0c3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1555 microversion: 2.1 time: 0.140899 Oct 27 01:22:02.709990 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 247/483] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:02 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:02.735396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:02.735996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:02.743054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.743478 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.744237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:02.744665 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:02.869545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:02.877193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-40e24264-a993-481e-a656-aa1f37126327 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.145323 Oct 27 01:22:02.881809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 237/484] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:02 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:03.379605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:03.380207 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:03.386054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.386512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:03.387285 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.387714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:03.512345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:03.520422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:03.522673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:03.523819 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0255af18-f024-42e7-bcd3-61a2e72c3c96 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1751 microversion: 2.20 time: 0.147928 Oct 27 01:22:03.524380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 248/485] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:03 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:03.726448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:03.726971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:03.732883 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.733329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:03.734102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.734536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:03.861536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:03.870193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba56e564-c2d2-44a7-894d-a1b710616879 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1561 microversion: 2.1 time: 0.147517 Oct 27 01:22:03.870772 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 238/486] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:03 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:03.893882 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:03.894590 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:03.901774 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.902279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:03.903070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:03.903505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:04.025640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:04.044041 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3ec1325e-845a-46c4-b152-be14d88b1592 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1358 microversion: 2.1 time: 0.142740 Oct 27 01:22:04.044041 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 249/487] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:03 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:04.439111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:04.439623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:04.447573 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:04.448862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:04.449762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:04.450229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:04.575054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:04.575655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:04.581279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:04.581716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:04.582500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:04.582924 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:04.705744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:04.714018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:04.715525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:04.716673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e5f5c1fb-d428-4e2d-bf2f-25f0e6fbbba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1751 microversion: 2.20 time: 0.145403 Oct 27 01:22:04.717228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 250/488] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:04 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1751 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:04.745953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'services' on Instance uuid 2c00af12-ba9b-4253-8e58-985becdb2ad0 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:22:05.034078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9c5b3ad9-fc1c-4579-a44b-561153729215 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments/0d631d19-696d-44a8-afcb-56356e140bc9" status: 202 len: 0 microversion: 2.1 time: 0.607769 Oct 27 01:22:05.046465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.046940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 239/489] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:22:04 2021] DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments/0d631d19-696d-44a8-afcb-56356e140bc9 => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:22:05.048118 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:05.053809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.054633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:05.057561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.057943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.062929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.062929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.063326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.063326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.063742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.064170 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.099657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-df2cf390-e391-4018-9e63-e008f54ec8c2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059254 Oct 27 01:22:05.100631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 251/490] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:05.198625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.206519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9fe2985c-1cd3-4410-aa24-98dca46bd6e8 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1546 microversion: 2.1 time: 0.158237 Oct 27 01:22:05.207225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 240/491] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:05.223611 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.224758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:05.233839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.233839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.233839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.234331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.353051 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.360762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4c3ce08f-0155-43aa-8a88-db86f79ba474 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1546 microversion: 2.1 time: 0.140835 Oct 27 01:22:05.361325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 252/492] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1546 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:05.376514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.379913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:05.379913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:05.381064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.381789 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Searching by: {'deleted': False, 'project_id': '5e37607855ec49b6af8f28274acba57b'} {{(pid=116348) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 27 01:22:05.388083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.388523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.389307 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.389736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.479579 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.multi_cell_list [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116348) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 27 01:22:05.574748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ef6db8eb-c506-471b-9850-a53edc9fa133 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201843 Oct 27 01:22:05.575511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 241/493] 10.222.0.32 () {58 vars in 1124 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:05.586699 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.587392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:05.593647 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.594177 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.594891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.595314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.722224 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.729448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dff05ea9-92cd-4667-b6ce-8b65b235af4c tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1546 microversion: 2.1 time: 0.147342 Oct 27 01:22:05.730104 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 253/494] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:05.752948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:05.752948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:05.754249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.755785 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.756749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:05.757370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:05.892147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.901884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.903550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:05.904793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3f3ff71c-a8b7-404e-a91b-03346d66f599 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.174234 Oct 27 01:22:05.905449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 242/495] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:05 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:06.111688 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:06.112617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:06.119195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:06.119635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:06.120389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:06.120816 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:06.149220 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-860ae532-26c3-4375-8f5b-9eace3c2ad35 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 Oct 27 01:22:06.155365 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 254/496] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:06 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:06.923167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:06.923800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:06.929967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:06.930435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:06.931181 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:06.931605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:07.050116 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:07.058445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:07.060012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:07.061138 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5953d8dd-e9f0-4fb1-b3f4-303ee7a22931 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.141640 Oct 27 01:22:07.061690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 243/497] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:06 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:07.161052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:07.162787 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:07.169007 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:07.169457 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:07.170259 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:07.170693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:07.199102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4444ab03-f5af-49e9-9825-63d15df89e18 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 Oct 27 01:22:07.199574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 255/498] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:07 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:08.079606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:08.080281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:08.086532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:08.086974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:08.087724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:08.088180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:08.207704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:08.210681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:08.211666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:08.216095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:08.217578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:08.217975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:08.218518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:08.218729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-88d26aa5-c8ea-4373-90dd-82140ca34db6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.142895 Oct 27 01:22:08.219287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 244/499] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:08 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:08.219440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:08.219898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:08.249335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5c150577-87fb-4453-bff7-991e1ae0051d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Oct 27 01:22:08.249882 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 256/500] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:08 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:22:09.237117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:09.237718 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:09.244505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:09.244966 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:09.245733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:09.246198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:09.260662 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:09.261653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:09.267897 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:09.268427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:09.269286 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:09.269787 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:09.300355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b34086f3-ddad-4688-999d-2a61ebf825f5 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Oct 27 01:22:09.300957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 257/501] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:09 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:22:09.371062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:09.379408 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:09.381853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:09.382054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6bc63173-0755-4a13-acdd-bcdfa06068e5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.148916 Oct 27 01:22:09.382609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 245/502] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:09 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:10.446128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:10.446128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:10.446128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:10.446128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:10.447548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:10.447548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:10.447548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2e9904ab-a85f-4fd8-bfea-5ddf04e6968b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040729 Oct 27 01:22:10.447548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 258/503] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:22:10 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:22:10.447865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:10.447865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:10.447865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:10.447865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:10.448506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:10.448506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:10.592398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:10.602098 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:10.605420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:10.605420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ad78f694-1035-4bc4-adcf-320d5dc59be0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.208173 Oct 27 01:22:10.606995 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 246/504] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:10 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:11.498124 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae84a01b-6c0e-48c3-8883-9b26a59eb590"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:11.499182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:11.505166 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:11.505634 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:11.506447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:11.506852 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:11.632620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:11.632620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:11.634982 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:11.635420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:11.636181 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:11.636604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:11.763147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:11.772166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:11.773632 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:11.774856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-989e6fe6-ab49-4b76-a094-f160307e28e9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.151773 Oct 27 01:22:11.775411 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 247/505] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:11 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:12.793331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:12.794706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:12.809683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:12.810347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:12.811289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:12.811715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:12.952664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:12.961636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:12.963243 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:12.964405 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a645213c-603c-44fa-a155-464027d380d5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.174842 Oct 27 01:22:12.964979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 248/506] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:12 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:13.996216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:13.997264 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:14.010773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:14.011223 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:14.012002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:14.012431 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:14.152069 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:14.175010 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:14.176738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:14.178350 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-639a099c-0e75-4c7d-8690-7de5bb81fb28 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.186417 Oct 27 01:22:14.178913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 249/507] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:13 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:14.945534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:14.946016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:14.951724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:14.952158 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:14.952903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:14.953330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:14.981048 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:22:15.364736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c640550b-ebb4-4345-b4f3-c570c450b131 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 204 len: 0 microversion: 2.1 time: 0.422421 Oct 27 01:22:15.365485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 250/508] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:22:14 2021] DELETE /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:22:15.370182 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:15.370858 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:15.376455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:15.376898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:15.377640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:15.378094 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:15.518609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:15.528957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:15.532540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:15.532540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f96d3357-2bde-4587-aa50-601eadb2b328 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.165203 Oct 27 01:22:15.532540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 251/509] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:15 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:15.537062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:15.537644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:15.547839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:15.548279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:15.549038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:15.549487 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:15.679535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:15.688787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a4020acb-fa06-4d04-a5a3-c52f9b9ba93f tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.155614 Oct 27 01:22:15.689453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 252/510] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:15 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:16.556983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:16.557661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:16.570401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:16.571085 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:16.572030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:16.572616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:16.702743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:16.712899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:16.714743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:16.716115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-98944fbe-7ffb-426e-93c9-175ea58b1e5a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.164614 Oct 27 01:22:16.716682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 253/511] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:16 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:16.721149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:16.721974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:16.728402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:16.728905 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:16.729681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:16.730153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:17.063765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:17.073358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fd7886bf-72f5-4e98-a66c-decd6d4e9366 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.355355 Oct 27 01:22:17.074065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 254/512] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:16 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:17.735698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:17.738916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:17.743841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:17.744462 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:17.745391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:17.745976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:17.897462 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:17.906109 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:17.907720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:17.908980 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-154eb8c5-5119-417b-a378-85af5fd3d169 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.177100 Oct 27 01:22:17.909607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 255/513] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:17 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:18.098137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:18.099259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:18.107140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:18.107884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:18.108670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:18.109103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:18.247861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:18.255726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6301a63f-8f82-47f1-ba9e-3251862bfb8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.162671 Oct 27 01:22:18.266789 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 256/514] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:18 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:18.928884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:19.025187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:19.025187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:19.025187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:19.025187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:19.026212 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:19.073429 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:19.094164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:19.094164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:19.094164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-369b50de-0d77-4e65-b6c0-473153d5f32b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.163254 Oct 27 01:22:19.094571 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 257/515] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:18 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:19.340490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:19.340490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:19.340490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:19.340490 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:19.342246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:19.342246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:19.435867 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:19.444119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5f10d473-7703-469b-9c62-1844e929eef3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.175284 Oct 27 01:22:19.444696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 258/516] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:19 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:20.106336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:20.107085 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:20.113151 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:20.113589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:20.114521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:20.114967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:20.244184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:20.252600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:20.254096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:20.256160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c7657207-14a1-4a23-b196-913c703b716b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.153586 Oct 27 01:22:20.257281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 259/517] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:20 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:20.461674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:20.462340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:20.468058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:20.468508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:20.469267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:20.469738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:20.616636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:20.624029 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6d697fc0-54f8-4b78-a8c4-404aeeda0cb8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.166907 Oct 27 01:22:20.624623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 260/518] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:20 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:21.276265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:21.276957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:21.282941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:21.283378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:21.284127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:21.284561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:21.443909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:21.452345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:21.453826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:21.454999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5857213a-ca7a-45ec-bff7-1a3840285524 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.182558 Oct 27 01:22:21.455564 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 261/519] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:21 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:21.640813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:21.641462 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:21.651256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:21.651759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:21.652544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:21.652978 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:21.819430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:21.826554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c5dca7e6-c652-4085-a368-e4cca7e29f87 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.189509 Oct 27 01:22:21.827123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 262/520] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:21 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:22.476814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:22.477314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:22.483868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:22.484363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:22.485247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:22.485707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:22.620754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:22.628230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:22.630402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:22.632186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f5e78697-b00a-4dca-aeb2-84bcc5eff5c5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.161726 Oct 27 01:22:22.633059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 263/521] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:22 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:22.843978 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:22.844689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:22.851136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:22.851576 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:22.852330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:22.852753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:23.003416 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:23.011346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2b64b332-2fad-4ea1-a111-658c2db88d28 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.171547 Oct 27 01:22:23.011906 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 264/522] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:22 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:23.656330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:23.657052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:23.663626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:23.664105 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:23.664814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:23.665381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:23.803150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:23.811816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:23.813305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:23.814786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bed6f9e1-7a44-4956-9767-83dad241b94c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.162545 Oct 27 01:22:23.818413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 265/523] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:23 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:24.028599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:24.029179 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:24.035012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:24.035452 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:24.036323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:24.036745 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:24.164330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:24.171773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-31a08535-a86c-4620-baa7-f95584747c8b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.146930 Oct 27 01:22:24.172339 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 266/524] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:24 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:24.834593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:24.835306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:24.841447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:24.841900 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:24.842743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:24.843176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:24.969627 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:24.978777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:24.980303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:24.981821 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5eca71c0-de46-4740-ba83-35605c69fbab tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.151806 Oct 27 01:22:24.992897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 267/525] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:24 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:25.188511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:25.189114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:25.195885 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:25.196545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:25.197308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:25.197740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:25.340661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:25.349073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e58216dc-571b-49a5-8c42-b1a21585fe0c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.163591 Oct 27 01:22:25.349854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 268/526] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:25 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:25.534401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-673d0a72-d1c8-4f69-bedb-d382f1560490 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.039913 Oct 27 01:22:25.535012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 259/527] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:22:11 2021] POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 194 bytes in 14041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:22:25.999707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:26.000245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:26.007013 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:26.007464 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:26.008252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:26.008682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:26.134991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:26.147710 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:26.149848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:26.150711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f44f7ad7-f812-4ec2-9193-558d54d45c5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.154840 Oct 27 01:22:26.151286 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 269/528] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:25 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:26.367589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:26.368273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:26.374204 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:26.374640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:26.375394 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:26.375821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:26.499652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:26.506873 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b738e2e7-343b-42fd-a469-b20866f43dcf tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.143854 Oct 27 01:22:26.507463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 260/529] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:26 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:27.169479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:27.170089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:27.176334 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:27.177646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:27.178590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:27.179607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:27.312552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:27.320716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:27.322428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:27.323574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c9e608a7-25eb-4a2a-ad2e-b6c3bfdd0687 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.157721 Oct 27 01:22:27.324129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 270/530] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:27 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:27.523885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:27.524483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:27.530906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:27.531691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:27.532591 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:27.533027 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:27.658817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:27.667892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-77da0e59-9a1d-4ff4-afa4-2ed31d03928c tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.148092 Oct 27 01:22:27.668482 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 261/531] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:27 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:28.342842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:28.343385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:28.349995 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:28.350457 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:28.351209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:28.351633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:28.474429 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:28.483868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:28.484716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:28.485863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f1b7fcfd-37ea-4319-8a0f-59e588aefcef tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.146938 Oct 27 01:22:28.486646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 271/532] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:28 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:28.686343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:28.686940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:28.693493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:28.694452 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:28.694739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:28.695171 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:28.825967 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:28.839482 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-50d9c94e-bb82-411d-a1e1-db24fe62b697 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1507 microversion: 2.1 time: 0.156474 Oct 27 01:22:28.840857 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 262/533] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:28 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:28.894668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-dfba75c7-8acc-4825-ab02-91002191d2df req-78224434-0a62-4d43-8cd7-a30dc223c533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5", "name": "network-vif-deleted", "tag": "73eeb8da-a290-4880-831a-db973bd4521e"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:28.898348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:28.898348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:28.905628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dfba75c7-8acc-4825-ab02-91002191d2df req-78224434-0a62-4d43-8cd7-a30dc223c533 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:28.906249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dfba75c7-8acc-4825-ab02-91002191d2df req-78224434-0a62-4d43-8cd7-a30dc223c533 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:28.918371 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-dfba75c7-8acc-4825-ab02-91002191d2df req-78224434-0a62-4d43-8cd7-a30dc223c533 service nova] Creating event network-vif-deleted:73eeb8da-a290-4880-831a-db973bd4521e for instance cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 on hv-cinder-81556 Oct 27 01:22:28.923560 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-dfba75c7-8acc-4825-ab02-91002191d2df req-78224434-0a62-4d43-8cd7-a30dc223c533 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Oct 27 01:22:28.924521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 272/534] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:29.504522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:29.505207 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:29.511046 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:29.511483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:29.512239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:29.512673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:29.679273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:29.689478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:29.692646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:29.694210 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-44688af6-6fe7-4d89-a870-b7c0ffa34b86 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.193359 Oct 27 01:22:29.694794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 263/535] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:29 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:29.857712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:29.858546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:29.866795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:29.866795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:29.867407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:29.867831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:29.905493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:29.906689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:29.907152 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'fault' on Instance uuid cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:22:29.958691 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:29.965981 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d628ca9d-3f88-4f00-be21-8b7ea8999565 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 200 len: 1311 microversion: 2.1 time: 0.112483 Oct 27 01:22:29.966583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 273/536] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:29 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:30.712877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:30.721375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:30.721375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:30.721375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:30.721375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:30.721758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:30.894613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:30.904894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:30.906589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:30.907869 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2e27fdf2-80e9-423c-b53c-c992ac40c0dc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.198734 Oct 27 01:22:30.908425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 264/537] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:30 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:30.983718 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:30.984321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:30.990755 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:30.991193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:30.991975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:30.992425 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.005387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] HTTP exception thrown: Instance cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 could not be found. Oct 27 01:22:31.005966 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Returning 404 to user: Instance cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:22:31.006812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1157c76d-87d5-4959-a6c7-37ab83f3d0d8 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5" status: 404 len: 111 microversion: 2.1 time: 0.027100 Oct 27 01:22:31.007359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 274/538] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:30 2021] GET /compute/v2.1/servers/cfd93d1f-7a2c-4a5e-b272-f8bb1e80b0e5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:31.015109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:31.019320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:31.021858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.022327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.023081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.023512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.053488 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:22:31.344890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-609cc6bd-5d7b-450e-96b1-234219052a7a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 204 len: 0 microversion: 2.1 time: 0.333158 Oct 27 01:22:31.345577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 265/539] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:22:31 2021] DELETE /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:22:31.353164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:31.353801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:31.359859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.360303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.361060 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.361493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.482451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:31.490042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5f17db3b-f343-4729-ad7b-507d06c0d9c4 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.140404 Oct 27 01:22:31.490614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 275/540] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:31 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:31.507363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:22:31.507517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:22:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:22:31.926193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:31.927673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:31.933837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.934471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:31.935304 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:31.935732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:32.077689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:32.088614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:32.090221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:32.091402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6bc6d6d5-ccce-42b4-a20d-477f331c1573 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.169236 Oct 27 01:22:32.091951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 266/541] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:31 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:32.507093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:32.507686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:32.513989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:32.514276 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:32.515089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:32.515437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:32.639975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:32.648030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-33610380-72eb-4bb4-9ddb-047518998585 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.144698 Oct 27 01:22:32.648593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 276/542] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:32 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:33.110193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:33.110831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:33.117783 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:33.118251 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:33.119013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:33.121343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:33.252398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:33.261509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:33.263129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:33.264396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-54cf3e95-78b3-4184-9508-93e95c3c1493 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.157898 Oct 27 01:22:33.266074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 267/543] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:33 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:33.664354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:33.664962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:33.671484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:33.671934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:33.672700 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:33.673135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:33.795829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:33.803991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6af1929a-7e1e-4689-8032-a397884032f9 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.143245 Oct 27 01:22:33.804561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 277/544] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:33 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:34.131324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:34.131931 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:34.138013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.138480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.139292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.139723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.272299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:34.280412 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-47ed0a0c-3792-4b16-aa59-4e427c07281b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1592 microversion: 2.1 time: 0.152674 Oct 27 01:22:34.280981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 268/545] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:34 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1592 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:34.283054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:34.283661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:34.290406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.291069 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.298371 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.298898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.426920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:34.434904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:34.436402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:34.437538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-aab42306-9ac9-41c6-96bd-6af7983ab40a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.158337 Oct 27 01:22:34.438109 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 278/546] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:34 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:34.821774 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:34.822550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:34.828487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.828934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.829713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:34.830173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:34.951222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:34.958496 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ff1ba0e0-9e97-4973-adb4-84b83e91cdb2 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.141329 Oct 27 01:22:34.959061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 269/547] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:34 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:35.443154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-7cc5aeaa-83b2-4875-9c03-3d4fdad2705f req-6c486bdd-f89b-4b0c-9bc5-4efeb0f3b3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "name": "network-vif-plugged", "status": "completed", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:35.445051 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:35.445051 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:35.454821 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7cc5aeaa-83b2-4875-9c03-3d4fdad2705f req-6c486bdd-f89b-4b0c-9bc5-4efeb0f3b3b7 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:35.455341 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7cc5aeaa-83b2-4875-9c03-3d4fdad2705f req-6c486bdd-f89b-4b0c-9bc5-4efeb0f3b3b7 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:35.458116 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:35.466398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:35.466398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:35.466398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:35.466742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:35.467372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:35.467943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-7cc5aeaa-83b2-4875-9c03-3d4fdad2705f req-6c486bdd-f89b-4b0c-9bc5-4efeb0f3b3b7 service nova] Creating event network-vif-plugged:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:22:35.473130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-7cc5aeaa-83b2-4875-9c03-3d4fdad2705f req-6c486bdd-f89b-4b0c-9bc5-4efeb0f3b3b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033578 Oct 27 01:22:35.474510 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 279/548] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:35.594376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:35.602806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:35.604321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:35.606141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6964aed8-673c-4502-afb8-adb1861d0e4f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.153260 Oct 27 01:22:35.606663 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 270/549] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:35 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:35.976506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:35.977200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:35.983552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:35.984010 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:35.984825 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:35.985254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.118271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:36.127543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-94e4c789-1c40-4812-88bd-9b9eecd4c3f3 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.155930 Oct 27 01:22:36.128117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 280/550] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:35 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:36.273353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1424798597", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:36.325429 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] validate_networks() for None {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:22:36.607790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:22:36.608356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:22:36.608676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:22:36.609081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:22:36.609487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:22:36.618573 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:36.619315 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.620058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:36.620485 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.624876 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:36.625476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:36.632958 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:36.633668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.634480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:36.634916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.638150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Getting quotas for project 62ba4e49116c4783802852db9449300f. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:22:36.642113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Getting quotas for user b6fd88eadf134e8a8a474e598c8c3bf6 and project 62ba4e49116c4783802852db9449300f. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:22:36.653742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:22:36.656071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:22:36.766529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:36.776469 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:36.778247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:36.779400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-90a69037-242d-452d-aa4f-c7700cecfca9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.158543 Oct 27 01:22:36.779942 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 281/551] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:36 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:36.805907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b32b286b-b212-4703-8315-e64adfea589c tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536674 Oct 27 01:22:36.807319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 271/552] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:22:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:22:36.810628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-c7b88c50-fa3f-4723-af74-3d5f86a36730 req-2812c768-3606-4702-a05d-f8aa2f91398d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:36.812451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:36.812451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:36.819946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-c7b88c50-fa3f-4723-af74-3d5f86a36730 req-2812c768-3606-4702-a05d-f8aa2f91398d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:36.820707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-c7b88c50-fa3f-4723-af74-3d5f86a36730 req-2812c768-3606-4702-a05d-f8aa2f91398d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:36.822474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8dfcd267-ad0f-4ef1-bc57-59a4a8b0d4ac tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:36.823179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8dfcd267-ad0f-4ef1-bc57-59a4a8b0d4ac tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:36.833588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-c7b88c50-fa3f-4723-af74-3d5f86a36730 req-2812c768-3606-4702-a05d-f8aa2f91398d service nova] Creating event network-changed:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:22:36.839128 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-c7b88c50-fa3f-4723-af74-3d5f86a36730 req-2812c768-3606-4702-a05d-f8aa2f91398d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031979 Oct 27 01:22:36.843198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 282/553] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:22:36.886622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8dfcd267-ad0f-4ef1-bc57-59a4a8b0d4ac tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:36.894373 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8dfcd267-ad0f-4ef1-bc57-59a4a8b0d4ac tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1215 microversion: 2.1 time: 0.080614 Oct 27 01:22:36.895694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 272/554] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:36 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:37.148389 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:37.149088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:37.164799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:37.165260 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:37.166519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:37.166960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:37.334493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:37.345224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2cfb5d16-3f8f-47cb-b8da-caab77411c9a tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.203698 Oct 27 01:22:37.347124 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 283/555] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:37 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:37.798619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:37.799323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:37.819250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:37.822100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:37.823154 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:37.825775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:37.913198 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fa0fca8c-0840-4905-a461-d134094cf560 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:37.914566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fa0fca8c-0840-4905-a461-d134094cf560 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:37.985356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fa0fca8c-0840-4905-a461-d134094cf560 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:38.003222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:38.007738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fa0fca8c-0840-4905-a461-d134094cf560 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1215 microversion: 2.1 time: 0.098804 Oct 27 01:22:38.008607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 284/556] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:37 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:38.017393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:38.017393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:38.018603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2cfc6be6-7d80-4d90-b3d9-76cfd007165c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.224276 Oct 27 01:22:38.020032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 273/557] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:37 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:38.362538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:38.368080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:38.369766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:38.370431 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:38.371311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:38.371816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:38.527948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:38.536844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b5d96678-0476-48d4-b4ed-59f9ea725f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.177786 Oct 27 01:22:38.537418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 285/558] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:38 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:38.839814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:22:38.840626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:22:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:22:39.024912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:39.025527 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:39.032579 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.033047 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.033816 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.034281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.043809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:39.043809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:39.046150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.046666 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.047440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.047859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.128127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:39.137018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fb228bd8-1525-4458-b081-ab78d17735c7 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1267 microversion: 2.1 time: 0.116558 Oct 27 01:22:39.145230 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 274/559] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:39 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:39.197073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:39.205294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:39.206808 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:39.207962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d9676bf6-c625-4c93-befe-1d8707aad0fe tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1807 microversion: 2.20 time: 0.175211 Oct 27 01:22:39.208513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 286/560] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:39 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:22:39.553092 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:39.553733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:39.559646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.560066 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.560821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:39.561243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:39.719257 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:39.729421 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9904a0e0-94f7-428c-89b3-8e7be8d74ab1 tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1521 microversion: 2.1 time: 0.180656 Oct 27 01:22:39.729989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 275/561] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:39 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:40.154229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:40.154930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:40.162711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.163171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.164500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.164500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.171614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1075865946"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:40.172729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:40.182532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.182980 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.183752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.186529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.234715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:40.245733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-81c76f13-6792-4e1b-88f4-b6759cab658f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1285 microversion: 2.1 time: 0.095052 Oct 27 01:22:40.246476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 287/562] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:40 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:40.270693 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:40.271628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:40.277841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.278615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.279475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.279964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.350599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.network.security_group_api [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Adding security group 5008b7d3-cb9b-4403-9a05-52e27afb2ad8 to port d271dfc3-2e52-484f-8433-9676c21da897 Oct 27 01:22:40.584203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:40.593368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:40.595234 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:40.597368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2fa51f2c-06ea-48ec-ace9-3f3f0b5f9446 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1794 microversion: 2.20 time: 0.331538 Oct 27 01:22:40.598466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 288/563] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:22:40 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1794 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:40.747918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:40.748516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:40.755002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.755574 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.756332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.756762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.849272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:40.861220 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16480922-307e-4fec-8448-185e9635774d tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1479 microversion: 2.1 time: 0.116803 Oct 27 01:22:40.861943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 289/564] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:40 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1479 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:40.932874 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-31c7800e-e1fd-4814-b34b-b01ecffd62d8 req-3c76cd65-58bb-4a5e-a36e-4b81a0a3823a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c00af12-ba9b-4253-8e58-985becdb2ad0", "name": "network-vif-deleted", "tag": "4f1eccc2-4d63-4101-be4a-ce4e532f88e2"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:40.934546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:40.934546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:40.941595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-31c7800e-e1fd-4814-b34b-b01ecffd62d8 req-3c76cd65-58bb-4a5e-a36e-4b81a0a3823a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:40.942267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-31c7800e-e1fd-4814-b34b-b01ecffd62d8 req-3c76cd65-58bb-4a5e-a36e-4b81a0a3823a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:40.953575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-31c7800e-e1fd-4814-b34b-b01ecffd62d8 req-3c76cd65-58bb-4a5e-a36e-4b81a0a3823a service nova] Creating event network-vif-deleted:4f1eccc2-4d63-4101-be4a-ce4e532f88e2 for instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 on hv-cinder-81556 Oct 27 01:22:40.959009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-31c7800e-e1fd-4814-b34b-b01ecffd62d8 req-3c76cd65-58bb-4a5e-a36e-4b81a0a3823a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029788 Oct 27 01:22:40.959636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 290/565] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:22:41.074586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-721aa19f-f553-4c33-a240-0b1c4a7237fe tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action" status: 202 len: 0 microversion: 2.1 time: 0.906799 Oct 27 01:22:41.075965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 276/566] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:22:40 2021] POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:22:41.086824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:41.087442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:41.091890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-d9dc5b38-c9e5-4dd3-804e-9cf6922177e4 req-8f9b3448-b8e8-43c0-935b-75d52e4cce2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:41.093488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:41.093488 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:41.093666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.094334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.095929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.096588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.103948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d9dc5b38-c9e5-4dd3-804e-9cf6922177e4 req-8f9b3448-b8e8-43c0-935b-75d52e4cce2c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.118634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d9dc5b38-c9e5-4dd3-804e-9cf6922177e4 req-8f9b3448-b8e8-43c0-935b-75d52e4cce2c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.155671 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-d9dc5b38-c9e5-4dd3-804e-9cf6922177e4 req-8f9b3448-b8e8-43c0-935b-75d52e4cce2c service nova] Creating event network-changed:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:22:41.170989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-d9dc5b38-c9e5-4dd3-804e-9cf6922177e4 req-8f9b3448-b8e8-43c0-935b-75d52e4cce2c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090949 Oct 27 01:22:41.172414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 291/567] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:41.265258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:41.266379 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:41.279667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.280402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.281361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.282563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.306696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:41.318332 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5939d32e-d471-4804-9461-e46656ad58d2 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1756 microversion: 2.1 time: 0.234959 Oct 27 01:22:41.321525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 277/568] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:41 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:41.430396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:41.442155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e6415c93-823e-4c87-9a08-323aaa3eff94 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1273 microversion: 2.1 time: 0.180816 Oct 27 01:22:41.444253 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 292/569] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:41 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:41.888207 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:41.888810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:41.895667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.896179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.896957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.897386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.937831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:41.938652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:41.939606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lazy-loading 'fault' on Instance uuid 2c00af12-ba9b-4253-8e58-985becdb2ad0 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:22:41.989528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac05d2fe5fa40b4a18063d0d335d9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac535690bf24eb9bbf7d42426b21c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:42.006617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-212f9473-3024-4b2e-bd41-3e84afaf2f6b tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 200 len: 1311 microversion: 2.1 time: 0.120383 Oct 27 01:22:42.007596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 278/570] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:41 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:42.459536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:42.460219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:42.466440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:42.467147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:42.467979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:42.468604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:42.604341 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:42.607923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c0393e64-ff51-498a-9b92-23cec51f92e2 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.152335 Oct 27 01:22:42.608690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 293/571] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:42 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:42.976557 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-b4f02bca-a8b7-4f20-abbc-71b33093c327 req-73c66c62-2097-45cb-9e30-12fd2252c720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa1674c5-2b41-4cd3-8f8b-a5b63265dae3", "tag": "0fc66269-a05f-4b7b-8274-871a91830c07"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:42.978126 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:42.978126 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:22:42.987140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-b4f02bca-a8b7-4f20-abbc-71b33093c327 req-73c66c62-2097-45cb-9e30-12fd2252c720 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:42.987579 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-b4f02bca-a8b7-4f20-abbc-71b33093c327 req-73c66c62-2097-45cb-9e30-12fd2252c720 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:42.998619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-b4f02bca-a8b7-4f20-abbc-71b33093c327 req-73c66c62-2097-45cb-9e30-12fd2252c720 service nova] Creating event network-changed:0fc66269-a05f-4b7b-8274-871a91830c07 for instance aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 on hv-cinder-81556 Oct 27 01:22:43.003748 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-b4f02bca-a8b7-4f20-abbc-71b33093c327 req-73c66c62-2097-45cb-9e30-12fd2252c720 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032053 Oct 27 01:22:43.004392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 279/572] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:43.024839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:43.025529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] [instance: 2c00af12-ba9b-4253-8e58-985becdb2ad0] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:43.031385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:43.031829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:43.032740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:43.033019 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:43.046991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] HTTP exception thrown: Instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 could not be found. Oct 27 01:22:43.047581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] Returning 404 to user: Instance 2c00af12-ba9b-4253-8e58-985becdb2ad0 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:22:43.048397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e000338c-8d90-4778-913f-94bec912eacb tempest-ServerRescueNegativeTestJSON-1723341576 tempest-ServerRescueNegativeTestJSON-1723341576-project] 10.222.0.32 "GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0" status: 404 len: 111 microversion: 2.1 time: 0.027378 Oct 27 01:22:43.048956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 294/573] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:43 2021] GET /compute/v2.1/servers/2c00af12-ba9b-4253-8e58-985becdb2ad0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:43.625250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:43.625995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:43.632321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:43.632845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:43.633882 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:43.634478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:43.926448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:43.934763 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0b5d0236-1a46-489e-adb1-08dbe8acd4de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.313568 Oct 27 01:22:43.935336 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 280/574] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:43 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:44.952413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:44.953016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:44.960197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:44.960637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:44.961594 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:44.962290 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:45.424062 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:45.433460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ecf05d09-8ea5-4b09-b8b2-11cdc9c41e5a tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.484790 Oct 27 01:22:45.434392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 295/575] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:44 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:46.452736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:46.453889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:46.464011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:46.464903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:46.466339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:46.466993 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:46.590621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:46.591161 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:46.599676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:46.600132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:46.601078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:46.601865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:46.686439 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:46.693894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8e2b44d4-773d-48f5-837a-2427befffb9d tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.246110 Oct 27 01:22:46.694634 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 281/576] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:46 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:46.711189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lazy-loading 'services' on Instance uuid 99cfc0a7-3f5a-4d41-abb9-e80fc370962f {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:22:46.875226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6f776dea-df71-4de2-a3ce-6c03bc46c3b4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments/ca57d6eb-55fc-44d1-8591-f2b4f4eeec5a" status: 202 len: 0 microversion: 2.1 time: 0.291503 Oct 27 01:22:46.875737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 296/577] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:22:46 2021] DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments/ca57d6eb-55fc-44d1-8591-f2b4f4eeec5a => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:22:47.623500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-2a10b150-12ae-4d9b-9647-8402419f8f6f req-b1168cfc-40e2-4e0d-9382-2da6c34e87e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1674c5-2b41-4cd3-8f8b-a5b63265dae3", "name": "network-vif-plugged", "status": "completed", "tag": "0fc66269-a05f-4b7b-8274-871a91830c07"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:47.625726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:47.625726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:22:47.633238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2a10b150-12ae-4d9b-9647-8402419f8f6f req-b1168cfc-40e2-4e0d-9382-2da6c34e87e1 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:47.633678 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2a10b150-12ae-4d9b-9647-8402419f8f6f req-b1168cfc-40e2-4e0d-9382-2da6c34e87e1 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:47.646929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-2a10b150-12ae-4d9b-9647-8402419f8f6f req-b1168cfc-40e2-4e0d-9382-2da6c34e87e1 service nova] Creating event network-vif-plugged:0fc66269-a05f-4b7b-8274-871a91830c07 for instance aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 on hv-cinder-81556 Oct 27 01:22:47.651981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-2a10b150-12ae-4d9b-9647-8402419f8f6f req-b1168cfc-40e2-4e0d-9382-2da6c34e87e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Oct 27 01:22:47.652640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 282/578] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:47.711954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:47.713435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:47.724640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:47.724640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:47.724640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:47.724640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:47.920497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:47.928742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5ae25535-c658-4598-9f20-b1ce51e416d8 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.221473 Oct 27 01:22:47.929599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 297/579] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:47 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:48.945312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:48.946040 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:48.951956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:48.952389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:48.953136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:48.953558 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:49.083743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:49.091654 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dcd2827b-dfc9-444a-8277-5473eade05e6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1315 microversion: 2.1 time: 0.150794 Oct 27 01:22:49.102129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 283/580] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:48 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:49.136007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3e1adc6c-1f24-418d-9081-9f84c468d974 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:49.142240 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e1adc6c-1f24-418d-9081-9f84c468d974 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:49.142686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e1adc6c-1f24-418d-9081-9f84c468d974 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:49.200996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3e1adc6c-1f24-418d-9081-9f84c468d974 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Going to try to stop instance {{(pid=116348) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 01:22:49.521604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3e1adc6c-1f24-418d-9081-9f84c468d974 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 202 len: 0 microversion: 2.1 time: 0.389132 Oct 27 01:22:49.522382 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 298/581] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:22:49 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:22:49.530372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:49.531099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:49.536942 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:49.537416 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:49.538277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:49.543390 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:49.668511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:49.676243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7cb33953-c671-4637-b384-66ed271df14d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.149009 Oct 27 01:22:49.676782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 284/582] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:49 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:50.110224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:50.110942 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:50.117052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.117493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.118274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.118704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.242384 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:50.249740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-707c8452-e8de-407a-a89d-54a6a97a326f tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1465 microversion: 2.1 time: 0.143480 Oct 27 01:22:50.250359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 299/583] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:50 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1465 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:50.289373 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:50.289858 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:50.296043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.296490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.297252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.297682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.323635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:22:50.692957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:50.698345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:50.698473 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-69a173c0-88f8-401d-bffa-65f110c0d016 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 204 len: 0 microversion: 2.1 time: 0.409752 Oct 27 01:22:50.698473 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 285/584] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:22:50 2021] DELETE /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:22:50.704273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.704478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:50.704926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.705165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:50.705700 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.706160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.711487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.712157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.713084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:50.713512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:50.899830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:50.907999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:50.912457 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dce93a64-64cc-44d2-9804-203f4dcfa1ca tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1471 microversion: 2.1 time: 0.211912 Oct 27 01:22:50.916727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 286/585] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:50 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:50.917940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f1956ff3-8014-4b44-8e1d-e785e739cf51 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.228534 Oct 27 01:22:50.918921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 300/586] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:50 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:51.077859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2083929980", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "c89d8d0d-00d8-415f-ae8d-2501c753c88f"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:51.127113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] validate_networks() for [('c89d8d0d-00d8-415f-ae8d-2501c753c88f', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:22:51.456268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:22:51.456831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:22:51.457405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:22:51.458062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:22:51.458485 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:22:51.467783 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.468218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:51.469002 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.469425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:51.486374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:22:51.490880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for user b35bfb19e59d4f3aa015cb094b2236fd and project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:22:51.501218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:22:51.503517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:22:51.622273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ec26c7eb-5745-4b9d-ac5a-0315e3aa117d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655169 Oct 27 01:22:51.622921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 287/587] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:22:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:22:51.633042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-abd50c85-2cca-41c0-a3a1-61fc11403c4d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:51.633774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-abd50c85-2cca-41c0-a3a1-61fc11403c4d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:51.691032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-abd50c85-2cca-41c0-a3a1-61fc11403c4d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:51.696761 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-abd50c85-2cca-41c0-a3a1-61fc11403c4d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1218 microversion: 2.1 time: 0.067589 Oct 27 01:22:51.702227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 301/588] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:51 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:51.931056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:51.931764 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:51.935500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:51.936104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:51.937902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.938478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:51.939391 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.939820 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:51.942527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.942981 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:51.943737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:51.944171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:52.123165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:52.126387 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:52.134710 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5e26c01e-8e7d-4a21-96ce-7582cbcaa9de tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1471 microversion: 2.1 time: 0.207274 Oct 27 01:22:52.134909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-351edf05-a8c6-41a3-962f-d842fc015ac5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.202776 Oct 27 01:22:52.135483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 288/589] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:51 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:52.135778 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 302/590] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:51 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:52.713357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:52.714049 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:52.720546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:52.721001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:52.721769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:52.722233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:52.782183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:52.790661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f065fa09-b1ae-4afa-97aa-b916d17dbd84 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1222 microversion: 2.1 time: 0.081025 Oct 27 01:22:52.791349 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 289/591] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:52 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:53.143545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-3efa80ef-6bdd-4eee-a669-d02ee2b2627e req-e984f3f3-2e21-40f9-bd4b-be2bff146598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1674c5-2b41-4cd3-8f8b-a5b63265dae3", "name": "network-vif-deleted", "tag": "0fc66269-a05f-4b7b-8274-871a91830c07"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:53.147430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:53.147430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:22:53.152354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:53.153367 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-3efa80ef-6bdd-4eee-a669-d02ee2b2627e req-e984f3f3-2e21-40f9-bd4b-be2bff146598 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.153653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:53.153812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-3efa80ef-6bdd-4eee-a669-d02ee2b2627e req-e984f3f3-2e21-40f9-bd4b-be2bff146598 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.165215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-3efa80ef-6bdd-4eee-a669-d02ee2b2627e req-e984f3f3-2e21-40f9-bd4b-be2bff146598 service nova] Creating event network-vif-deleted:0fc66269-a05f-4b7b-8274-871a91830c07 for instance aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 on hv-cinder-81556 Oct 27 01:22:53.167215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.167760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.169344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.170701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.170831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-3efa80ef-6bdd-4eee-a669-d02ee2b2627e req-e984f3f3-2e21-40f9-bd4b-be2bff146598 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Oct 27 01:22:53.171522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 303/592] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:53.179952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:53.180636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:53.186993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.187441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.188212 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.188645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.263155 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:53.272029 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-958fd07d-b8a8-4acd-a6fe-ca4c571f894b tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1429 microversion: 2.1 time: 0.124417 Oct 27 01:22:53.272688 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 290/593] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:53 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1429 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:53.353759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:53.361880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f406718a-84e6-4e97-b89a-9420c6079dd8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.186306 Oct 27 01:22:53.362561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 304/594] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:53 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:53.813708 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:53.813708 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:53.814494 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.814930 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.815704 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:53.816131 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:53.885177 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:53.892212 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-74963233-e8ce-471b-a926-fc0f46e7293e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1270 microversion: 2.1 time: 0.088183 Oct 27 01:22:53.892781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 291/595] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:53 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:54.288993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:54.294116 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:54.296766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.296766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.303434 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.303884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.335832 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.336352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.336890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lazy-loading 'fault' on Instance uuid aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:22:54.380974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:54.381903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:54.390489 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.395909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.395909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.395909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.423183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd88eadf134e8a8a474e598c8c3bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ba4e49116c4783802852db9449300f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:54.431839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e722a697-4138-47e7-b3ea-8ca226804ab6 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 200 len: 1305 microversion: 2.1 time: 0.147177 Oct 27 01:22:54.432601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 305/596] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:54 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:54.540415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:54.549824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-883ef3fe-3dcf-4e7b-a18d-86fc2e2ff141 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.174470 Oct 27 01:22:54.551402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 292/597] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:54 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:54.909251 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:54.909850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:54.915714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.916154 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:54.916897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:54.917320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.068527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:55.072105 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-794cf971-7c00-4852-92c2-532c100c6ec5 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.166430 Oct 27 01:22:55.072670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 306/598] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:54 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:55.298524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:55.298524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:55.304696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.305374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.306183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.306778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.456130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:55.456950 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] [instance: aa1674c5-2b41-4cd3-8f8b-a5b63265dae3] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:55.463712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.464163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.468869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.468869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.480941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] HTTP exception thrown: Instance aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 could not be found. Oct 27 01:22:55.481544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] Returning 404 to user: Instance aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:22:55.482423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-71fd0fcc-f1b1-4239-ab3b-977251786de4 tempest-VolumesNegativeTest-2137580352 tempest-VolumesNegativeTest-2137580352-project] 10.222.0.32 "GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3" status: 404 len: 111 microversion: 2.1 time: 0.036106 Oct 27 01:22:55.486072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 307/599] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:55 2021] GET /compute/v2.1/servers/aa1674c5-2b41-4cd3-8f8b-a5b63265dae3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:55.569049 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:55.569786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:55.577974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.582756 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.582756 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.582756 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.614213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-02b0d1fb-5ecb-400b-8f0f-5cd750c7a175 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action" status: 202 len: 0 microversion: 2.1 time: 0.321648 Oct 27 01:22:55.617241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 293/600] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:22:55 2021] POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:22:55.624945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:55.625832 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:55.633308 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.633884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.634789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:55.635322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:55.748931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:55.756868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-43db718f-1d37-4417-8013-1a6866d48691 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.192535 Oct 27 01:22:55.757445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 308/601] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:55 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:55.823419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:55.831972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5f2f67ed-be2e-4e51-ad56-1b2156b60b37 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1748 microversion: 2.1 time: 0.211689 Oct 27 01:22:55.832977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 294/602] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:55 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1748 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:56.089439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:56.090068 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:56.095726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.096165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.096912 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.097340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.220770 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:56.228744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bca0426a-38bb-4ced-a10b-ceddcb7ff9de tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.143228 Oct 27 01:22:56.229525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 309/603] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:56 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:56.290495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-eaeda8f8-7300-4cd0-8be9-f255af3a532e req-c00ca89c-205e-4f63-8c56-1b5207b37b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c63b91-4304-474a-a244-d87f58ccf234", "tag": "3c2e10e7-5f1e-4d8b-8f85-8ee84618befe"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:22:56.300269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:56.300269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:22:56.300269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-eaeda8f8-7300-4cd0-8be9-f255af3a532e req-c00ca89c-205e-4f63-8c56-1b5207b37b7e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.300269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-eaeda8f8-7300-4cd0-8be9-f255af3a532e req-c00ca89c-205e-4f63-8c56-1b5207b37b7e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.315009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-eaeda8f8-7300-4cd0-8be9-f255af3a532e req-c00ca89c-205e-4f63-8c56-1b5207b37b7e service nova] Creating event network-changed:3c2e10e7-5f1e-4d8b-8f85-8ee84618befe for instance 04c63b91-4304-474a-a244-d87f58ccf234 on hv-cinder-81556 Oct 27 01:22:56.320530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-eaeda8f8-7300-4cd0-8be9-f255af3a532e req-c00ca89c-205e-4f63-8c56-1b5207b37b7e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034091 Oct 27 01:22:56.321124 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 295/604] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:22:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:56.774552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:56.775305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:56.781450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.781892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.782725 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.783180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.849784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:56.850772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:56.858938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.859382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.860485 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:56.860584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:56.954228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:56.961871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d9bdf9ca-e6ed-44cf-a1d0-2fe6bdccddf8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.191220 Oct 27 01:22:56.963875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 310/605] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:56 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:57.046794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:57.057715 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9914b1b6-3090-4943-a592-46242e99de9b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1748 microversion: 2.1 time: 0.211819 Oct 27 01:22:57.059032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 296/606] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:56 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1748 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:57.246102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:57.246639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:57.254222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:57.254761 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:57.255726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:57.256163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:57.398526 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:57.406134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba50611c-9b26-4be5-99b5-f4fea57be1ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.163809 Oct 27 01:22:57.406879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 311/607] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:57 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:57.978730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:57.979359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:57.986443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:57.986939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:57.987800 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:57.988898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:58.076320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:58.076929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:58.083978 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:58.084351 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:58.085299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:58.085854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:58.125064 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:58.132875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bbcb0e5c-4ada-42f0-9c64-82f15fc33c67 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.157675 Oct 27 01:22:58.133671 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 297/608] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:57 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:58.216280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:58.224893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ebb166ae-2236-4b9f-bec3-2722562bbc6a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.151966 Oct 27 01:22:58.225467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 312/609] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:58 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:58.423268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:58.424039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:58.430772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:58.431299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:58.432198 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:58.432845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:58.564906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:58.572891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5b82ecb6-0f05-4cc5-9aa1-4a9961f146f8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.153147 Oct 27 01:22:58.573455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 298/610] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:58 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:59.149824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:59.150467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:59.156961 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.157395 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.158191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.158616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.244342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:59.246069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:59.254139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.254770 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.255324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.255762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.291652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:59.319626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ac86b872-e3ca-47ab-a167-02979b522cab tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1677 microversion: 2.1 time: 0.173255 Oct 27 01:22:59.320950 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 313/611] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:59 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:22:59.388398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:59.398619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-493b9f85-e7ac-4a10-bf88-b3f88cb7748b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.157671 Oct 27 01:22:59.399444 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 299/612] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:59 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:22:59.589480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:59.590116 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:22:59.595887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.596319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.597087 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:22:59.597657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:22:59.730395 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:22:59.738819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-06f3f8e7-b89d-46cb-83e0-ebfd13a31132 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.151939 Oct 27 01:22:59.739400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 314/613] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:22:59 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:00.337479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:00.339212 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:00.346334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.349173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.349173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.349173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.415517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:00.416112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:00.422374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.423862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.423862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.424135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.558169 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:00.565285 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8e14bd46-2933-45d1-b689-ed70bb942d08 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1654 microversion: 2.1 time: 0.231536 Oct 27 01:23:00.565845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 300/614] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:00 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1654 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:00.585092 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-381a2da1-29f4-4685-a69d-200179f04b07 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:00.590800 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-381a2da1-29f4-4685-a69d-200179f04b07 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.591251 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-381a2da1-29f4-4685-a69d-200179f04b07 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.615250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-381a2da1-29f4-4685-a69d-200179f04b07 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Going to try to start instance {{(pid=116349) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 01:23:00.623043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:00.631247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c72839f8-9fb5-4dca-a43b-3d0c953c74cb tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.219376 Oct 27 01:23:00.631812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 315/615] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:00 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:00.755561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:00.756162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:00.762004 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.762516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.763314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.763742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.788935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-381a2da1-29f4-4685-a69d-200179f04b07 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action" status: 202 len: 0 microversion: 2.1 time: 0.207402 Oct 27 01:23:00.789982 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 301/616] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:23:00 2021] POST /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:23:00.806016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:00.806647 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:00.813069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.813624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.814914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:00.815502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:00.953432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:00.961173 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-024843c2-4cbd-43cd-b75b-d583c718b3b9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.209465 Oct 27 01:23:00.961752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 316/617] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:00 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:00.980829 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:00.995409 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-379c638b-5183-430e-9b55-d76edd35e843 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1663 microversion: 2.1 time: 0.193305 Oct 27 01:23:01.004487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 302/618] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:00 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1663 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:01.648698 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:01.649328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-631a83f0-313f-40fc-878f-80de9d0fa720 req-9430cacd-4938-4387-9239-2d98507d02f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c63b91-4304-474a-a244-d87f58ccf234", "name": "network-vif-plugged", "status": "completed", "tag": "3c2e10e7-5f1e-4d8b-8f85-8ee84618befe"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:01.649738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:01.650634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:01.650634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:01.656352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:01.657934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:01.658130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-631a83f0-313f-40fc-878f-80de9d0fa720 req-9430cacd-4938-4387-9239-2d98507d02f0 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:01.658737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-631a83f0-313f-40fc-878f-80de9d0fa720 req-9430cacd-4938-4387-9239-2d98507d02f0 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:01.659041 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:01.659578 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:01.669760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-631a83f0-313f-40fc-878f-80de9d0fa720 req-9430cacd-4938-4387-9239-2d98507d02f0 service nova] Creating event network-vif-plugged:3c2e10e7-5f1e-4d8b-8f85-8ee84618befe for instance 04c63b91-4304-474a-a244-d87f58ccf234 on hv-cinder-81556 Oct 27 01:23:01.674824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-631a83f0-313f-40fc-878f-80de9d0fa720 req-9430cacd-4938-4387-9239-2d98507d02f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029636 Oct 27 01:23:01.676370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 317/619] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:01.793596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:01.801896 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-94d3e436-5de3-4898-9fca-4ab49f451ef0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.156945 Oct 27 01:23:01.802505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 303/620] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:01 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:01.978444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:01.979461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:01.986374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:01.987291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:01.987626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:01.992614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:02.018944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:02.020805 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:02.027693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:02.029036 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:02.029815 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:02.030273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:02.176167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:02.176167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a8264ba6-68b5-4679-9254-97548b3df80a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.180675 Oct 27 01:23:02.176167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 318/621] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:01 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:02.200210 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:02.208592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-54893bf3-c08d-4aa1-9c53-694e64a01013 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1663 microversion: 2.1 time: 0.193444 Oct 27 01:23:02.209174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 304/622] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:02 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:02.819425 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:02.820005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:02.826400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:02.826859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:02.827611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:02.828039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:02.949651 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:02.957451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d0f47601-2120-4bd9-bc9c-871bbbe78b0b tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.142629 Oct 27 01:23:02.958014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 319/623] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:02 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:03.171093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:03.171711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:03.177865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.178331 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:03.179074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.179516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:03.227145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:03.227860 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:03.234159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.234684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:03.235519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.236166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:03.347079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:03.355666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-746ac0d1-92d0-468e-93ec-f5d0449f7067 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1318 microversion: 2.1 time: 0.188093 Oct 27 01:23:03.356241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 305/624] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:03 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:03.385653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:03.393006 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fbf3954b-8883-4098-90be-94faae49166a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1667 microversion: 2.1 time: 0.170754 Oct 27 01:23:03.393573 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 320/625] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:03 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:03.974719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:03.975245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:03.981351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.981823 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:03.982616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:03.983052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:04.103065 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:04.110968 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fdb58ea6-65de-4814-b7df-a4fb65b1da51 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.140317 Oct 27 01:23:04.111532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 306/626] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:03 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:04.372152 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:04.372665 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:04.378895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:04.379480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:04.380226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:04.380649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:04.497439 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:04.504548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9ae1e973-7f9e-4004-8fc1-4f919a6688a2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1508 microversion: 2.1 time: 0.136163 Oct 27 01:23:04.505107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 321/627] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:04 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1508 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:05.129153 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:05.129746 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:05.135928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:05.136344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:05.137090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:05.137514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:05.271669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:05.271669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f2ee4ab0-f218-4965-b428-d0631cf1dc2a tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.145284 Oct 27 01:23:05.271669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 307/628] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:05 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:06.287967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:06.288572 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:06.294955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:06.295406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:06.296166 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:06.297216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:06.315956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e9b0150-88bb-469a-ad65-f39a605ff43f"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:06.317833 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:06.324097 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:06.324617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:06.325471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:06.325972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:06.422607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:06.431773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fa115a42-4523-4879-a515-6679d1f117e6 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.147466 Oct 27 01:23:06.432422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 322/629] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:06 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:07.099303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ef8a1b03-84d4-4148-b60c-900632c22cc4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787166 Oct 27 01:23:07.099915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 308/630] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:23:06 2021] POST /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:07.448694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:07.449311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:07.455506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:07.455936 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:07.457347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:07.457776 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:07.581954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:07.589638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e48ac300-2046-4f98-963c-651773463297 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1753 microversion: 2.1 time: 0.144505 Oct 27 01:23:07.590227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 323/631] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:07 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1753 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:08.608085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:08.608722 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:08.614950 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:08.615418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:08.616795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:08.617235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:08.743505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:08.751151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6a5bb077-3840-4750-9253-e6addac5379e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1756 microversion: 2.1 time: 0.147972 Oct 27 01:23:08.751716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 309/632] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:08 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:15.690612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-926187640", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "c89d8d0d-00d8-415f-ae8d-2501c753c88f"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:15.742817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] validate_networks() for [('c89d8d0d-00d8-415f-ae8d-2501c753c88f', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:23:16.092323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:23:16.092741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:23:16.093203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:23:16.093600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:23:16.094004 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:23:16.102529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:16.102913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:16.103735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:16.104165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:16.120217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:16.124018 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for user b35bfb19e59d4f3aa015cb094b2236fd and project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:16.135026 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:23:16.137271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:23:16.335979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0af63819-1090-4b62-bd6e-eadbfed4e9c6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648918 Oct 27 01:23:16.336620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 324/633] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:23:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:23:16.346299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0d8d2a6d-519b-4234-a508-b70665f57926 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:16.347004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0d8d2a6d-519b-4234-a508-b70665f57926 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:16.399939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0d8d2a6d-519b-4234-a508-b70665f57926 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:16.406349 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0d8d2a6d-519b-4234-a508-b70665f57926 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1217 microversion: 2.1 time: 0.063702 Oct 27 01:23:16.406939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 310/634] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:16 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:17.422853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:17.423485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:17.430580 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.431075 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.431782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.432213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.491176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:17.498358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f5436cbb-6509-456d-986c-913cf3525821 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1221 microversion: 2.1 time: 0.079220 Oct 27 01:23:17.498943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 325/635] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:17 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:17.772397 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:17.772977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:17.779917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.780379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.781137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.781571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.811426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-94eb36c9-bced-4a0e-9b4d-892d64588345 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments/227acafa-6d7f-4348-936c-771cbb8ad403" status: 200 len: 194 microversion: 2.20 time: 0.043409 Oct 27 01:23:17.812000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 311/636] 10.222.0.32 () {60 vars in 1453 bytes} [Wed Oct 27 01:23:17 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments/227acafa-6d7f-4348-936c-771cbb8ad403 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:23:17.884536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:17.885031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:17.890844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.891288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.892070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:17.892508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:17.971168 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lazy-loading 'services' on Instance uuid ef2a60d0-e2da-4415-8558-1da7a803e3f4 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:18.165964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-72fe4886-9126-43a1-b61f-2887eeb4c0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments/227acafa-6d7f-4348-936c-771cbb8ad403" status: 202 len: 0 microversion: 2.20 time: 0.285032 Oct 27 01:23:18.166718 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 326/637] 10.222.0.32 () {60 vars in 1456 bytes} [Wed Oct 27 01:23:17 2021] DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments/227acafa-6d7f-4348-936c-771cbb8ad403 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:23:18.175510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:18.176461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:18.182181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:18.185956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:18.185956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:18.185956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:18.214552 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e9e4ada6-3bcf-40eb-87fc-e0ef07fa50aa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041776 Oct 27 01:23:18.214552 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 312/638] 10.222.0.32 () {60 vars in 1342 bytes} [Wed Oct 27 01:23:18 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:23:18.516530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:18.517137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:18.523455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:18.523897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:18.524656 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:18.525701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:18.586658 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:18.593920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-18efafd7-07cb-47fd-92bb-619017415ba8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1277 microversion: 2.1 time: 0.082115 Oct 27 01:23:18.594527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 327/639] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:18 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:19.224449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:19.225976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:19.232477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:19.232920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:19.233683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:19.234131 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:19.264686 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f227ba92-8020-4892-971a-5d8f8415a744 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044052 Oct 27 01:23:19.269197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 313/640] 10.222.0.32 () {60 vars in 1342 bytes} [Wed Oct 27 01:23:19 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:23:19.610477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:19.611102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:19.617571 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:19.618014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:19.618811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:19.619567 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:19.750294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:19.758448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2a3f9c91-ca3d-49ca-8d02-8eccb31b5a5f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.151536 Oct 27 01:23:19.759023 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 328/641] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:19 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:20.276042 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:20.276977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:20.283267 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.283717 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.284518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.284954 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.312964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-73feecbd-079b-4862-8491-e27f1585c9a0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040709 Oct 27 01:23:20.313523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 314/642] 10.222.0.32 () {60 vars in 1342 bytes} [Wed Oct 27 01:23:20 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:20.369854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:20.370603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:20.376597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.377047 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.377812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.378313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.383930 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-c387ca77-2174-462d-9451-7876ff616cf3 req-7fb31a2b-6074-4ba5-8336-7db6536f5245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad358cb-e3ad-4b49-8030-2e357c401601", "tag": "53ddad0e-9508-4aac-a462-30949e2d214b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:20.385643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:20.385643 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:23:20.393662 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c387ca77-2174-462d-9451-7876ff616cf3 req-7fb31a2b-6074-4ba5-8336-7db6536f5245 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.394379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c387ca77-2174-462d-9451-7876ff616cf3 req-7fb31a2b-6074-4ba5-8336-7db6536f5245 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.405876 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-c387ca77-2174-462d-9451-7876ff616cf3 req-7fb31a2b-6074-4ba5-8336-7db6536f5245 service nova] Creating event network-changed:53ddad0e-9508-4aac-a462-30949e2d214b for instance dad358cb-e3ad-4b49-8030-2e357c401601 on hv-cinder-81556 Oct 27 01:23:20.414780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-c387ca77-2174-462d-9451-7876ff616cf3 req-7fb31a2b-6074-4ba5-8336-7db6536f5245 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Oct 27 01:23:20.414780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 315/643] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:20.414962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:23:20.698480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e998c8a1-775e-48c9-93c6-5a6e63260aa7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 204 len: 0 microversion: 2.20 time: 0.331995 Oct 27 01:23:20.699258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 329/644] 10.222.0.32 () {60 vars in 1279 bytes} [Wed Oct 27 01:23:20 2021] DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:23:20.708444 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:20.709158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:20.715393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.715827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.716588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.717042 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.776028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:20.776813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:20.784060 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.785378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.786258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:20.786889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:20.874595 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:20.885413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:20.887411 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:20.888807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b1f46297-c10f-45c6-9e76-864ad775a691 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.185139 Oct 27 01:23:20.889371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 316/645] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:20 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:20.930981 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:20.938648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-90238608-4d67-425c-a783-979833d17b3d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.166523 Oct 27 01:23:20.940953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 330/646] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:20 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:21.907439 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:21.908044 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:21.914576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:21.915024 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:21.915790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:21.916228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:21.955984 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:21.957306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:21.963539 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:21.963984 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:21.964736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:21.965164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:22.063235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:22.072085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:22.073609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:22.074816 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1d5da48c-fdbd-4f6d-95da-b4613268a82d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.171111 Oct 27 01:23:22.075383 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 317/647] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:21 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:22.112875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:22.120061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9acb03e5-6a30-45ff-9777-378e12159837 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.167743 Oct 27 01:23:22.120629 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 331/648] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:21 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:23.093198 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:23.093795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:23.100650 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:23.101089 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:23.101838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:23.102291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:23.136210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:23.136808 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:23.143011 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:23.143929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:23.144828 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:23.145450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:23.247409 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:23.255297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:23.256701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:23.257842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-38d6bc78-e904-4344-aa9a-08c0ab3ec30b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1722 microversion: 2.20 time: 0.168347 Oct 27 01:23:23.258430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 318/649] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:23 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:23.297328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:23.304908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7eac7e6e-0098-414e-8cc3-3e477bac7849 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.172233 Oct 27 01:23:23.305468 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 332/650] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:23 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:24.281541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:24.281541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:24.286182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:24.288110 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:24.289295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:24.289874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:24.321875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:24.323237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:24.334991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:24.336012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:24.337522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:24.341465 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:24.375420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:24.384514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:24.386006 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:24.387206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-94d4480f-4a7e-4482-8992-b609af46bbeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1654 microversion: 2.20 time: 0.113897 Oct 27 01:23:24.388003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 319/651] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:24 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1654 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:24.474709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:24.482141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d2dba370-0011-4874-9d3d-69fd2dc713f9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.164005 Oct 27 01:23:24.482708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 333/652] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:24 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:24.592839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-cb766736-acad-4407-b523-f1b57b761237 req-d92ed76a-f5c4-4e9d-9409-f477ecfc804a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a60d0-e2da-4415-8558-1da7a803e3f4", "name": "network-vif-deleted", "tag": "2eb0ecba-543e-4b15-8729-cbda338ab01b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:24.594594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:24.594594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:23:24.602942 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-cb766736-acad-4407-b523-f1b57b761237 req-d92ed76a-f5c4-4e9d-9409-f477ecfc804a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:24.603661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-cb766736-acad-4407-b523-f1b57b761237 req-d92ed76a-f5c4-4e9d-9409-f477ecfc804a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:24.616090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-cb766736-acad-4407-b523-f1b57b761237 req-d92ed76a-f5c4-4e9d-9409-f477ecfc804a service nova] Creating event network-vif-deleted:2eb0ecba-543e-4b15-8729-cbda338ab01b for instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 on hv-cinder-81556 Oct 27 01:23:24.620965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-cb766736-acad-4407-b523-f1b57b761237 req-d92ed76a-f5c4-4e9d-9409-f477ecfc804a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Oct 27 01:23:24.621550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 320/653] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:25.404609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:25.405308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:25.413052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.413509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.414343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.414946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.450624 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.452760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.452760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lazy-loading 'fault' on Instance uuid ef2a60d0-e2da-4415-8558-1da7a803e3f4 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:25.494280 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:25.507737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:25.509281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:25.509803 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:25.510605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:25.511008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-956c2b57-8d87-43a7-8403-322ebbb71015 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 200 len: 1371 microversion: 2.20 time: 0.110219 Oct 27 01:23:25.511568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 334/654] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:25 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:25.524221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.524671 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.525454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.525945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.848811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-06aab6ac-3470-4266-8bb7-bd16145eb9bb req-9530d894-b7a5-4356-a65e-ad5ba76adb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad358cb-e3ad-4b49-8030-2e357c401601", "name": "network-vif-plugged", "status": "completed", "tag": "53ddad0e-9508-4aac-a462-30949e2d214b"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:25.850528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:25.850528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:25.862363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-06aab6ac-3470-4266-8bb7-bd16145eb9bb req-9530d894-b7a5-4356-a65e-ad5ba76adb5e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:25.863273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-06aab6ac-3470-4266-8bb7-bd16145eb9bb req-9530d894-b7a5-4356-a65e-ad5ba76adb5e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:25.878605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-06aab6ac-3470-4266-8bb7-bd16145eb9bb req-9530d894-b7a5-4356-a65e-ad5ba76adb5e service nova] Creating event network-vif-plugged:53ddad0e-9508-4aac-a462-30949e2d214b for instance dad358cb-e3ad-4b49-8030-2e357c401601 on hv-cinder-81556 Oct 27 01:23:25.883983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-06aab6ac-3470-4266-8bb7-bd16145eb9bb req-9530d894-b7a5-4356-a65e-ad5ba76adb5e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039335 Oct 27 01:23:25.884790 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 335/655] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:25.898648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:25.905921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1b122c54-38e7-441e-b317-431b73394b75 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.409988 Oct 27 01:23:25.906660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 321/656] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:25 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:26.530709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:26.531390 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:26.537752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:26.538228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:26.539009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:26.539440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:26.552023 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. Oct 27 01:23:26.552596 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:23:26.553399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9d32032d-dddf-4bd3-80a3-4e586e84a0ca tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 404 len: 111 microversion: 2.20 time: 0.026858 Oct 27 01:23:26.553956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 336/657] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:26 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:23:26.562117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7561c8e2-c3bf-4538-bafe-11b6b518a651 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '.version_select at 0x7f1d363c2040>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:26.667014 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7561c8e2-c3bf-4538-bafe-11b6b518a651 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316864813" status: 204 len: 0 microversion: 2.20 time: 0.108539 Oct 27 01:23:26.667598 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 322/658] 10.222.0.32 () {60 vars in 1258 bytes} [Wed Oct 27 01:23:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316864813 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:23:26.933891 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:26.933891 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:26.937967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:26.938450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:26.939336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:26.939771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:27.133444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:27.140903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b443837b-b574-4131-9b5d-d248cad8bbb4 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1317 microversion: 2.1 time: 0.221091 Oct 27 01:23:27.142343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 337/659] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:26 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:27.606401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: .version_select at 0x7f1d363c4820>, body: {"keypair": {"name": "tempest-keypair-1771910299"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:27.626949 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:27.634223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:28.158451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:28.159499 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:28.166133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.166586 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.167355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.167791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.287418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:28.294681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-09bc4aeb-8f69-4ef7-b45f-1395c7c8ed32 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1507 microversion: 2.1 time: 0.139853 Oct 27 01:23:28.295231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 338/660] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:28 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1507 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:28.311604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e9b0150-88bb-469a-ad65-f39a605ff43f"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:28.313781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:28.318450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.318893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.319646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.320076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.395576 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Invalid volume: volume 4e9b0150-88bb-469a-ad65-f39a605ff43f is already attached to instances: 04c63b91-4304-474a-a244-d87f58ccf234 Oct 27 01:23:28.396215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 400 to user: Invalid volume: volume 4e9b0150-88bb-469a-ad65-f39a605ff43f is already attached to instances: 04c63b91-4304-474a-a244-d87f58ccf234 {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:23:28.397072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9d67b9da-cac8-4b35-a640-f182da5f484c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089117 Oct 27 01:23:28.397607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 339/661] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:23:28 2021] POST /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601/os-volume_attachments => generated 174 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 01:23:28.520637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:28.520637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:28.520637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.520637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.521032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.521032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.521196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:28.521196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:28.521196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-33a2c725-f09e-485e-af39-1d9d62c95ae0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.917287 Oct 27 01:23:28.521196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 323/662] 10.222.0.32 () {62 vars in 1198 bytes} [Wed Oct 27 01:23:27 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 918 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:23:28.568497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'services' on Instance uuid 04c63b91-4304-474a-a244-d87f58ccf234 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:28.807451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-50800cd8-4399-486a-9bb8-e0a065d0eec7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments/4e9b0150-88bb-469a-ad65-f39a605ff43f" status: 202 len: 0 microversion: 2.1 time: 0.328209 Oct 27 01:23:28.808253 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 340/663] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:23:28 2021] DELETE /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments/4e9b0150-88bb-469a-ad65-f39a605ff43f => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:23:28.817363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:28.818305 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:28.831495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.831943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.832726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:28.833158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:28.863660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c6f53839-45ce-4a41-9d09-fd3be47b4ac7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Oct 27 01:23:28.864509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 324/664] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:28 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:29.875849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:29.876888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:29.883630 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:29.884076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:29.884864 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:29.885303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:29.915094 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-97d78f79-66b3-45ed-b645-a6a4f9d0ee10 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Oct 27 01:23:29.915706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 341/665] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:29 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:30.806847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-171956544", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "337a2dfd-96cd-45e0-abce-401982e807e4"}], "security_groups": [{"name": "tempest-securitygroup--645863499"}], "key_name": "tempest-keypair-1771910299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:30.897597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] validate_networks() for [('337a2dfd-96cd-45e0-abce-401982e807e4', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:23:30.927270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:30.928269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:30.934486 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:30.934930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:30.935688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:30.936127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:30.965864 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fc551eb1-62b8-4460-8f79-e68bb3d8b90d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043027 Oct 27 01:23:30.966455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 342/666] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:30 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:23:31.067321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1366461306", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "c89d8d0d-00d8-415f-ae8d-2501c753c88f"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:31.118518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] validate_networks() for [('c89d8d0d-00d8-415f-ae8d-2501c753c88f', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:23:31.379125 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:23:31.379540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:23:31.380000 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:23:31.380402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:23:31.380923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:23:31.389720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:31.390205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:31.391011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:31.391512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:31.408070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:31.412951 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Getting quotas for user ff1374f1e319492da48f32b53c91f3ac and project 6304b3ad2b4e4bf398ccbae70b72f46d. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:31.423556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:23:31.426954 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:23:31.563501 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e1e002cb-c75e-4dca-adaa-47bb8f021cb1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.760632 Oct 27 01:23:31.564287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 325/667] 10.222.0.32 () {62 vars in 1187 bytes} [Wed Oct 27 01:23:30 2021] POST /compute/v2.1/servers => generated 401 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 01:23:31.575735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:23:31.581654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:23:31.581654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:23:31.581654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:23:31.581654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:23:31.582157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:31.582157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:31.587807 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:31.588253 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:31.589112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:31.589541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:31.610118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:31.614910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for user b35bfb19e59d4f3aa015cb094b2236fd and project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:31.652507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:23:31.652507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:23:31.652808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:31.652808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:31.653101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:31.653101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e196148d-3c94-4722-87cc-4f5fefe12642 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1281 microversion: 2.20 time: 0.077626 Oct 27 01:23:31.653101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 326/668] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:31 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:23:31.774962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6319930d-9f02-4e71-870b-092c09f2e1bd tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712117 Oct 27 01:23:31.775584 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 343/669] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:23:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:23:31.785475 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c1a8615c-c03b-4612-b334-d2bdf732295d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:31.786129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c1a8615c-c03b-4612-b334-d2bdf732295d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:31.836726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c1a8615c-c03b-4612-b334-d2bdf732295d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:31.843739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c1a8615c-c03b-4612-b334-d2bdf732295d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1218 microversion: 2.1 time: 0.061743 Oct 27 01:23:31.844136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 327/670] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:31 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:32.666468 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:32.666999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:32.672848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:32.673313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:32.674073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:32.674509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:32.735089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:32.742848 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:32.748773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:32.748773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9e176a62-89a9-4aab-baac-d9698e37ad94 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1285 microversion: 2.20 time: 0.083289 Oct 27 01:23:32.748773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 344/671] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:32 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:32.860579 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:32.861183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:32.868073 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:32.868553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:32.869323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:32.869756 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:32.928155 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:32.935394 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c3af20ff-4e3c-4537-b912-e75cdda51760 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1222 microversion: 2.1 time: 0.078431 Oct 27 01:23:32.942260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 328/672] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:32 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:33.763471 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:33.764098 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:33.770430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:33.770875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:33.771632 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:33.772061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:33.834618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:33.842332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:33.843816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:33.844901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c917aef1-deef-4bcf-b603-8fc554a8d65f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1333 microversion: 2.20 time: 0.085147 Oct 27 01:23:33.845463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 345/673] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:33 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:33.952502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:33.953031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:33.960759 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:33.961322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:33.962837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:33.963384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:34.025553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:34.031743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-56000bfc-3dd9-45ec-848a-defa5c4524f1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1214 microversion: 2.1 time: 0.082911 Oct 27 01:23:34.032313 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 329/674] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:33 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:34.863979 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:34.864513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:34.870715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:34.871163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:34.871956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:34.872412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:34.931751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:34.939328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:34.941796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:34.942996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-808c08b9-524a-40e6-b16a-8e71fc46544d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1339 microversion: 2.20 time: 0.083589 Oct 27 01:23:34.944447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 346/675] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:34 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:35.048393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:35.049142 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:35.057046 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:35.057868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:35.058938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:35.059537 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:35.157011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:35.165195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8403e7de-0110-4d6c-a353-c2c03744936b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1278 microversion: 2.1 time: 0.120297 Oct 27 01:23:35.165784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 330/676] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:35 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:35.963649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:35.963649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:35.971996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:35.972683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:35.973731 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:35.974402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:36.111221 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:36.119589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:36.121070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:36.122224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d6b2106c-db3a-4e19-b86b-3cac379e5d1a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.164703 Oct 27 01:23:36.122781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 347/677] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:35 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:36.183021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:36.184211 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:36.192931 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:36.193416 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:36.194992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:36.195431 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:36.322847 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-ea97e65d-ed3d-4dc4-baef-2513643674a6 req-da0f7d0f-f455-4bff-9247-5719eb69f6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:36.324590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:36.324590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:36.334661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ea97e65d-ed3d-4dc4-baef-2513643674a6 req-da0f7d0f-f455-4bff-9247-5719eb69f6af service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:36.335520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ea97e65d-ed3d-4dc4-baef-2513643674a6 req-da0f7d0f-f455-4bff-9247-5719eb69f6af service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:36.351668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-ea97e65d-ed3d-4dc4-baef-2513643674a6 req-da0f7d0f-f455-4bff-9247-5719eb69f6af service nova] Creating event network-changed:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:23:36.356805 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:36.366276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f8488b37-4b92-467e-a9b2-f76f9bec2228 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.187183 Oct 27 01:23:36.367763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-ea97e65d-ed3d-4dc4-baef-2513643674a6 req-da0f7d0f-f455-4bff-9247-5719eb69f6af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048382 Oct 27 01:23:36.367893 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 331/678] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:36 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:36.368661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 348/679] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:37.140323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:37.141716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:37.146925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:37.147386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:37.148136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:37.148572 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:37.271214 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:37.278939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:37.280482 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:37.281576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-733a7f33-661a-440e-9b88-2abe6c578f65 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.144974 Oct 27 01:23:37.282160 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 332/680] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:37 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:37.384899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:37.385589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:37.391552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:37.392000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:37.392763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:37.393235 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:37.515359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:37.522959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6248a0f9-c308-4bde-82c5-2924418b3b6a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.142376 Oct 27 01:23:37.523463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 349/681] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:37 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:38.300948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:38.301551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:38.307664 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:38.308103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:38.308923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:38.309351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:38.381272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-24049270-0d21-4e2a-82d9-fc29c734b6ec req-6686e65c-8c7b-4ae6-b744-2aff3f4941e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ef3a98-3711-4393-a080-0660ad63f97c", "tag": "ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:38.382820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:38.382820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:38.391148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-24049270-0d21-4e2a-82d9-fc29c734b6ec req-6686e65c-8c7b-4ae6-b744-2aff3f4941e8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:38.391779 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-24049270-0d21-4e2a-82d9-fc29c734b6ec req-6686e65c-8c7b-4ae6-b744-2aff3f4941e8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:38.404676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-24049270-0d21-4e2a-82d9-fc29c734b6ec req-6686e65c-8c7b-4ae6-b744-2aff3f4941e8 service nova] Creating event network-changed:ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4 for instance e9ef3a98-3711-4393-a080-0660ad63f97c on hv-cinder-81556 Oct 27 01:23:38.410169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-24049270-0d21-4e2a-82d9-fc29c734b6ec req-6686e65c-8c7b-4ae6-b744-2aff3f4941e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032644 Oct 27 01:23:38.410765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 350/682] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:38.435285 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:38.443238 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:38.444737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:38.445822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-272ad471-993e-43f8-8b5d-89053c553b4b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.149409 Oct 27 01:23:38.446408 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 333/683] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:38 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:38.540724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:38.541413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:38.547765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:38.548427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:38.549205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:38.549663 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:38.673501 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:38.681590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fd7d6834-430e-470d-839a-f5391771c61d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.144862 Oct 27 01:23:38.682188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 351/684] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:38 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:39.464339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:39.464923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:39.471093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:39.471538 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:39.472299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:39.472725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:39.590799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:39.599263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:39.600757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:39.601856 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-04b5b16a-e04e-4baa-b3e3-0e773486a368 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.141455 Oct 27 01:23:39.602466 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 334/685] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:39 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:39.698803 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:39.699410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:39.706532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:39.706532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:39.707298 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:39.707727 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:39.832473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:39.838232 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-dd44dd18-3949-4f2d-b4a9-90eb1d588b0a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.143503 Oct 27 01:23:39.838827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 352/686] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:39 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:40.620694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:40.621209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:40.628009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:40.628443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:40.629187 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:40.629610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:40.746776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:40.754913 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:40.756379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:40.757461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f6c11523-a1a7-49e0-a8de-31792a6bb35a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.140586 Oct 27 01:23:40.758004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 335/687] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:40 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:40.855539 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:40.856145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:40.862417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:40.862861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:40.863612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:40.864040 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:40.980643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:40.987917 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0146ef8d-2eb6-4142-90b8-de85b52fabcc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.136319 Oct 27 01:23:40.988493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 353/688] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:40 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:41.775398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:41.775985 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:41.782345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:41.782789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:41.784106 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:41.784737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:41.914928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:41.922596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:41.924725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:41.926044 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2db53daf-cb53-48ca-a296-79a95db02ad6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.154388 Oct 27 01:23:41.926748 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 336/689] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:41 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:42.004418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:42.005022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:42.011366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:42.011812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:42.012604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:42.013058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:42.079966 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-05b03d3b-eb1c-4186-a3cd-3163c5f26df9 req-72a98ae6-415f-488a-a015-48484b34084d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "name": "network-vif-plugged", "status": "completed", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:42.081283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:42.081283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:23:42.089143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-05b03d3b-eb1c-4186-a3cd-3163c5f26df9 req-72a98ae6-415f-488a-a015-48484b34084d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:42.089583 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-05b03d3b-eb1c-4186-a3cd-3163c5f26df9 req-72a98ae6-415f-488a-a015-48484b34084d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:42.105161 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-05b03d3b-eb1c-4186-a3cd-3163c5f26df9 req-72a98ae6-415f-488a-a015-48484b34084d service nova] Creating event network-vif-plugged:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:23:42.110497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-05b03d3b-eb1c-4186-a3cd-3163c5f26df9 req-72a98ae6-415f-488a-a015-48484b34084d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035541 Oct 27 01:23:42.113252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 337/690] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:42.136423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:42.144305 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-895ca568-ea98-4b15-b90d-0c04bf1ee17f tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.143459 Oct 27 01:23:42.144865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 354/691] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:41 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:42.952094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:42.952774 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:42.959095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:42.959533 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:42.960304 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:42.960728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:43.079718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:43.087359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:43.088865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:43.089943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4f2eb654-e7ab-49ba-9e0b-33d91ce49105 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.141887 Oct 27 01:23:43.090526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 338/692] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:42 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:43.161030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:43.161615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:43.167762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:43.168205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:43.168956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:43.169384 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:43.291846 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:43.299758 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4821fdd2-df8f-48f2-a10d-dbc05e334a2e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.142078 Oct 27 01:23:43.300323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 355/693] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:43 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:44.107984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:44.108625 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:44.115484 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.115798 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.116559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.117025 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.125525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-cca8ba47-c5fe-4ed0-a2af-ff5a649df279 req-e381fd38-bda7-4a0d-9ec6-a544b6ef8a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ef3a98-3711-4393-a080-0660ad63f97c", "name": "network-vif-plugged", "status": "completed", "tag": "ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:44.127268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:44.127268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:44.134292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cca8ba47-c5fe-4ed0-a2af-ff5a649df279 req-e381fd38-bda7-4a0d-9ec6-a544b6ef8a8f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.134733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cca8ba47-c5fe-4ed0-a2af-ff5a649df279 req-e381fd38-bda7-4a0d-9ec6-a544b6ef8a8f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.146968 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-cca8ba47-c5fe-4ed0-a2af-ff5a649df279 req-e381fd38-bda7-4a0d-9ec6-a544b6ef8a8f service nova] Creating event network-vif-plugged:ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4 for instance e9ef3a98-3711-4393-a080-0660ad63f97c on hv-cinder-81556 Oct 27 01:23:44.151888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-cca8ba47-c5fe-4ed0-a2af-ff5a649df279 req-e381fd38-bda7-4a0d-9ec6-a544b6ef8a8f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 Oct 27 01:23:44.152495 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 356/694] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:44.242710 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:44.251052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:44.252553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:44.253656 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-56ea922a-ac17-436d-8d7b-dadd76c20dd9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1406 microversion: 2.20 time: 0.149749 Oct 27 01:23:44.254252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 339/695] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:44 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:23:44.317310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:44.318009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:44.324413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.330805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.330805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.330805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.454785 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:44.463028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fd3b120f-05b4-41f6-b9ce-ec19f9deee72 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.150226 Oct 27 01:23:44.467785 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 357/696] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:44 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:44.747741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:44.748743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:44.755245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.755683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.756434 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.756857 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.785052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-aa97f3e8-e1bf-4a3b-a4d6-eb7ea9328d94 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040970 Oct 27 01:23:44.785610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 340/697] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:44 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:23:44.842420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:44.842910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:44.849274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.849708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.850489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:44.850919 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:44.874999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:23:45.213818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16734ab0-552e-4433-b353-5ce0c00c431c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 204 len: 0 microversion: 2.1 time: 0.374665 Oct 27 01:23:45.214441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 358/698] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:23:44 2021] DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:23:45.223119 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:45.223719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:45.230325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.230762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.231510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.231935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.273214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:45.273819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:45.279930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.280380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.281165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.281600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.383072 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:45.390342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-550ef597-ce9a-43b8-9f14-d075f694080a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1673 microversion: 2.1 time: 0.171583 Oct 27 01:23:45.390908 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 341/699] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:45 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:45.431475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:45.439105 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:45.440696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:45.441846 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e055e9c1-6bfd-405b-ae9d-bd53b45ab7de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1598 microversion: 2.20 time: 0.172853 Oct 27 01:23:45.442435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 359/700] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:23:45 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:23:45.462474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:45.462953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:45.468853 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.469290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.470054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.470479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.479675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:45.480409 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:45.486342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.490355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.490355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:45.490355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:45.581817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bf12e176-f4c4-4299-9ba5-4f5faf4d4e34 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.123077 Oct 27 01:23:45.582460 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 342/701] 10.222.0.32 () {60 vars in 1315 bytes} [Wed Oct 27 01:23:45 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:23:45.635410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:45.642685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-56846347-f729-41b9-be88-e12af60f820a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1318 microversion: 2.1 time: 0.166788 Oct 27 01:23:45.644674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 360/702] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:45 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:46.409224 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:46.409902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:46.416147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.416588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.417349 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.417775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.541888 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:46.551027 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ffdf3f50-c0cb-40eb-9e2b-d65b377543a6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1673 microversion: 2.1 time: 0.146379 Oct 27 01:23:46.551741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 343/703] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:46 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:46.664138 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:46.664883 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:46.670763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.671205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.671957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.672384 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.744636 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:46.745881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:46.751814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.752377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.753226 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.753718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.803680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:46.811536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-56514058-f023-4c1f-b5fb-3ac129c022ff tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1509 microversion: 2.1 time: 0.151112 Oct 27 01:23:46.812111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 361/704] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:46 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:46.817002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-c721a0fe-f70e-4e94-8bf4-0f19532bf431 req-6412fd9e-7ecd-41d6-83c4-a668e173d49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:46.818731 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:46.818731 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:46.827484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-c721a0fe-f70e-4e94-8bf4-0f19532bf431 req-6412fd9e-7ecd-41d6-83c4-a668e173d49a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:46.828099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-c721a0fe-f70e-4e94-8bf4-0f19532bf431 req-6412fd9e-7ecd-41d6-83c4-a668e173d49a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:46.840300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-c721a0fe-f70e-4e94-8bf4-0f19532bf431 req-6412fd9e-7ecd-41d6-83c4-a668e173d49a service nova] Creating event network-changed:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:23:46.845075 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-c721a0fe-f70e-4e94-8bf4-0f19532bf431 req-6412fd9e-7ecd-41d6-83c4-a668e173d49a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Oct 27 01:23:46.846482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 362/705] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:46.870050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ee4b61e5-031c-4f4d-81a0-7a2346361ef4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.129494 Oct 27 01:23:46.870900 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 344/706] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:46 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:47.569620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:47.570348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:47.576532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:47.576976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:47.577746 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:47.578213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:47.708391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:47.716059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-90158328-aa20-4c13-bde0-f8f1a2d761bd tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1673 microversion: 2.1 time: 0.151564 Oct 27 01:23:47.716645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 363/707] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:47 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:47.881592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:47.882575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:47.889398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:47.890103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:47.890889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:47.891338 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:48.075654 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-71041d9f-02d3-4fdd-a9ea-7c0530fe116f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.198197 Oct 27 01:23:48.080266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 345/708] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:47 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:48.426720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936a3b5c-ec15-474c-8ee9-07af273588b1"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:48.427831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:48.433588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:48.434114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:48.434904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:48.435329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:48.733633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:48.734521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:48.741613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:48.742152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:48.743161 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:48.743772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:48.879603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:48.890091 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1102fda3-aa84-4b86-a28e-cb5a351fc664 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1673 microversion: 2.1 time: 0.159723 Oct 27 01:23:48.890091 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 346/709] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:48 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:49.086795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:49.087845 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:49.094314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.094759 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.095523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.096618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.202174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2514779f-adc6-4df8-b814-add83c3e479e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.118826 Oct 27 01:23:49.202732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 347/710] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:49 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:49.366518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7bc6143c-9f5a-4770-b5cb-094d17e2cefe tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943779 Oct 27 01:23:49.368164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 364/711] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:23:48 2021] POST /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:49.418486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-ed7d7af0-9575-49f1-9a26-e191afa24afd req-552bf2ca-2ec2-4645-8bb6-06c2230dc4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cfc0a7-3f5a-4d41-abb9-e80fc370962f", "name": "network-vif-deleted", "tag": "e4440d0d-eda6-40ea-8ff3-ed879ecaf17e"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:49.420323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:49.420323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:23:49.429357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-ed7d7af0-9575-49f1-9a26-e191afa24afd req-552bf2ca-2ec2-4645-8bb6-06c2230dc4b9 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.430003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-ed7d7af0-9575-49f1-9a26-e191afa24afd req-552bf2ca-2ec2-4645-8bb6-06c2230dc4b9 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.443526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-ed7d7af0-9575-49f1-9a26-e191afa24afd req-552bf2ca-2ec2-4645-8bb6-06c2230dc4b9 service nova] Creating event network-vif-deleted:e4440d0d-eda6-40ea-8ff3-ed879ecaf17e for instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f on hv-cinder-81556 Oct 27 01:23:49.448463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-ed7d7af0-9575-49f1-9a26-e191afa24afd req-552bf2ca-2ec2-4645-8bb6-06c2230dc4b9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034908 Oct 27 01:23:49.449463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 348/712] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:49.908901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:49.909522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:49.915493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.915941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.916713 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.917149 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.952603 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:49.953073 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:49.953492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lazy-loading 'fault' on Instance uuid 99cfc0a7-3f5a-4d41-abb9-e80fc370962f {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:49.994355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:50.002732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bf190dbc-2283-4c21-b54f-591f3aff4aaf tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 200 len: 1328 microversion: 2.1 time: 0.097948 Oct 27 01:23:50.003406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 365/713] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:49 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:50.214318 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:50.215326 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:50.222360 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:50.222807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:50.223596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:50.224028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:50.330505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c2196052-2942-4a55-8b85-271150bf1dc6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.120437 Oct 27 01:23:50.332151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 349/714] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:50 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:51.019428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:51.020059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:51.026298 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.026745 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.027497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.027925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.041098 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. Oct 27 01:23:51.041679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:23:51.042520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba7710ac-adc7-4640-a797-2029802afdf4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 404 len: 111 microversion: 2.1 time: 0.026829 Oct 27 01:23:51.043042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 366/715] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:51 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:23:51.052288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4628e589-401f-41f3-9701-85a53e2ca214 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '.version_select at 0x7f1d363594c0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:51.162952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4628e589-401f-41f3-9701-85a53e2ca214 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451479014" status: 202 len: 0 microversion: 2.1 time: 0.115269 Oct 27 01:23:51.163540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 350/716] 10.222.0.32 () {58 vars in 1220 bytes} [Wed Oct 27 01:23:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451479014 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:23:51.342535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:51.343342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:51.349791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.350334 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.351091 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.351527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.449178 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7e1fef1c-825b-4c99-9104-f6ca1bc995e1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.110352 Oct 27 01:23:51.452314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 367/717] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:51 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:51.763855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1075865946"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:51.764496 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:51.771050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.771489 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.772236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:51.772659 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:51.960479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.network.security_group_api [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Removing security group 5008b7d3-cb9b-4403-9a05-52e27afb2ad8 from port d271dfc3-2e52-484f-8433-9676c21da897 Oct 27 01:23:51.992381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: .version_select at 0x7f1d361038b0>, body: {"keypair": {"name": "tempest-keypair-218735733"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:52.012764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:52.017487 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:52.261704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:52.265291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'key_pairs'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:52.277844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6f7f7c8c-a338-4979-87fd-b808713022d9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.289565 Oct 27 01:23:52.278532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 368/718] 10.222.0.32 () {60 vars in 1157 bytes} [Wed Oct 27 01:23:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:52.351085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-28a76a9d-88cb-4281-8287-966966fa80f0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action" status: 202 len: 0 microversion: 2.1 time: 0.591418 Oct 27 01:23:52.352760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 351/719] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:23:51 2021] POST /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:23:52.362994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-dcdea4b0-003f-47a7-afe4-ba83f628cd81 req-98391cd4-aaeb-4aa5-a06c-925a45834e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:52.365732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:52.365732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:52.373405 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dcdea4b0-003f-47a7-afe4-ba83f628cd81 req-98391cd4-aaeb-4aa5-a06c-925a45834e40 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:52.373640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dcdea4b0-003f-47a7-afe4-ba83f628cd81 req-98391cd4-aaeb-4aa5-a06c-925a45834e40 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:52.394777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-dcdea4b0-003f-47a7-afe4-ba83f628cd81 req-98391cd4-aaeb-4aa5-a06c-925a45834e40 service nova] Creating event network-changed:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:23:52.399858 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-dcdea4b0-003f-47a7-afe4-ba83f628cd81 req-98391cd4-aaeb-4aa5-a06c-925a45834e40 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040995 Oct 27 01:23:52.400814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 369/720] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:52.460287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:52.461269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:52.467996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:52.474192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:52.474192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:52.474192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:52.573224 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-09ac09f4-8eeb-427b-a2b9-18ee0b99bb0e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.116529 Oct 27 01:23:52.577085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 352/721] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:52 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:53.585674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:53.586716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:53.592679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:53.594826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:53.594826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:53.594826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:53.679015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c5ae8ef4-7f44-41fc-8361-39bfa65f6731 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.097747 Oct 27 01:23:53.679790 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 370/722] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:53 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:54.090254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:54.090807 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:54.097720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.098194 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.098956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.099557 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.220999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lazy-loading 'services' on Instance uuid 343ff586-2029-4b30-ac5f-f827cf95a0ce {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:54.415572 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-0ecba827-83a2-4552-a310-be9d595de57c req-c93b12d9-6ce1-40ca-b988-ecf4dded20e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:54.417022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:54.417022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:23:54.425401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-0ecba827-83a2-4552-a310-be9d595de57c req-c93b12d9-6ce1-40ca-b988-ecf4dded20e8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.425843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-0ecba827-83a2-4552-a310-be9d595de57c req-c93b12d9-6ce1-40ca-b988-ecf4dded20e8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.437146 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-0ecba827-83a2-4552-a310-be9d595de57c req-c93b12d9-6ce1-40ca-b988-ecf4dded20e8 service nova] Creating event network-changed:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:23:54.442914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-0ecba827-83a2-4552-a310-be9d595de57c req-c93b12d9-6ce1-40ca-b988-ecf4dded20e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031523 Oct 27 01:23:54.443512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 371/723] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:54.529883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6cfe21f0-549d-4d6f-bfb8-13581e9f6eed tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments/ae84a01b-6c0e-48c3-8883-9b26a59eb590" status: 202 len: 0 microversion: 2.1 time: 0.441426 Oct 27 01:23:54.530879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 353/724] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:23:54 2021] DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments/ae84a01b-6c0e-48c3-8883-9b26a59eb590 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:23:54.540664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:54.541576 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:54.553119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.553628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.555323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.556764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.592297 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bc7dabe1-6dbb-48bd-a800-cee522fbcf79 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056151 Oct 27 01:23:54.593327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 372/725] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:54 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:54.690183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:54.691268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:54.701245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.701832 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.702680 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:54.703228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:54.808197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-de4ca0d8-70fd-4a8d-b8b7-8ac3952740d3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.121954 Oct 27 01:23:54.808847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 354/726] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:54 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:55.239207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2141263297", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5b7050d-f17d-40a3-83d0-485beb1349f9"}], "security_groups": [{"name": "tempest-securitygroup--581221871"}], "key_name": "tempest-keypair-218735733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:55.329699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] validate_networks() for [('b5b7050d-f17d-40a3-83d0-485beb1349f9', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:23:55.604361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:55.605347 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:55.612122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.612122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.613360 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.613738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.644078 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8c6edbbb-8f51-40a7-9351-4f3acb405c1e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Oct 27 01:23:55.644822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 355/727] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:55 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:55.690444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:23:55.690919 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:23:55.691304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:23:55.691697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:23:55.692096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:23:55.700570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.701005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.701786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.702325 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.720394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for project ba4a231d73f5454eb53e08db96f0a471. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:23:55.725006 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Getting quotas for user e97b78644a8046da928880c62b18253d and project ba4a231d73f5454eb53e08db96f0a471. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:23:55.738181 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:23:55.741140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:23:55.819103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:55.820001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:55.826213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.826655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.827410 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:55.827833 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:55.937492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4bd96e9a-c1dd-4f7c-b36f-1dbed1d71f84 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.122002 Oct 27 01:23:55.938244 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 356/728] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:55 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:55.969135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-186604c4-670e-4399-8a3d-087ba4237572 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734192 Oct 27 01:23:55.970602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 373/729] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:23:55 2021] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:23:55.980973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ceee20c2-d10f-4aea-9dcb-cc984de9f203 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:55.981655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ceee20c2-d10f-4aea-9dcb-cc984de9f203 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:56.039095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ceee20c2-d10f-4aea-9dcb-cc984de9f203 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:56.045493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ceee20c2-d10f-4aea-9dcb-cc984de9f203 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1237 microversion: 2.1 time: 0.068843 Oct 27 01:23:56.046082 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 357/730] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:55 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:56.655969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:56.656921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:56.663489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:56.663941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:56.664735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:56.665174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:56.693379 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-348b84c4-67f4-41e6-a5b2-437eb8eb5164 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Oct 27 01:23:56.694053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 374/731] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:56 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:56.948606 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:56.949540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:56.955866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:56.956327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:56.957082 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:56.957505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.062427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:57.062960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:57.068911 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.069365 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.070200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.070638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.071720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e9680881-6da1-43f4-9da9-91c5104b9c76 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.126631 Oct 27 01:23:57.072356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 358/732] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:56 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:57.135830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:57.143801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cea2335b-8fc1-4bc9-b3b7-20c159eb2a92 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1241 microversion: 2.1 time: 0.085048 Oct 27 01:23:57.144366 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 375/733] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:57 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:57.706096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:57.707015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:57.713752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.717193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.717193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.717193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.748817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-323fa308-2cbb-48e4-a9c1-fb604ae44f85 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047713 Oct 27 01:23:57.749386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 359/734] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:57 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:57.950816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936a3b5c-ec15-474c-8ee9-07af273588b1"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:57.951902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:57.958129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.958516 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:57.959299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:57.959728 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.033686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Invalid volume: volume 936a3b5c-ec15-474c-8ee9-07af273588b1 is already attached to instances: e9ef3a98-3711-4393-a080-0660ad63f97c Oct 27 01:23:58.034298 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 400 to user: Invalid volume: volume 936a3b5c-ec15-474c-8ee9-07af273588b1 is already attached to instances: e9ef3a98-3711-4393-a080-0660ad63f97c {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:23:58.035155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-66062ce7-102f-457b-ba58-b439d916a163 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.088196 Oct 27 01:23:58.035689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 376/735] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:23:57 2021] POST /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:23:58.082915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:58.083824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.090150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.090589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.091346 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.091773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.092460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.092955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.099210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.108842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.108842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.108842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.179471 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'services' on Instance uuid e9ef3a98-3711-4393-a080-0660ad63f97c {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:23:58.208461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ac01a65b-93d6-4213-9088-8e34d93584bb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 14 microversion: 2.20 time: 0.129289 Oct 27 01:23:58.211824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 360/736] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:58 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:58.214147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.214868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.222989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.222989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.224691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.224691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.293206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:58.295926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dd9175da-885d-4bb7-a1fe-29e107270852 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1289 microversion: 2.1 time: 0.085685 Oct 27 01:23:58.296669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 361/737] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:58 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:23:58.502717 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba17626c-2959-43e1-9938-7f3d08c79635 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments/936a3b5c-ec15-474c-8ee9-07af273588b1" status: 202 len: 0 microversion: 2.1 time: 0.413726 Oct 27 01:23:58.503357 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 377/738] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:23:58 2021] DELETE /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments/936a3b5c-ec15-474c-8ee9-07af273588b1 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:23:58.511418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.512403 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.519718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.520247 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.521084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.521582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.553605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-131435bc-ca10-4d6e-ae05-06fc18c50fa2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Oct 27 01:23:58.554307 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 362/739] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:58 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:58.761639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.762692 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.769855 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.770446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.771215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.771639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.801639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a107fd7b-ef18-4fed-94fb-c8f0e5839035 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044597 Oct 27 01:23:58.802352 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 378/740] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:58 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:23:58.812234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.812726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:58.819314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.819815 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.820588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:58.821019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:58.895956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] HTTP exception thrown: Instance 343ff586-2029-4b30-ac5f-f827cf95a0ce is not attached to volume ae84a01b-6c0e-48c3-8883-9b26a59eb590 Oct 27 01:23:58.896603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Returning 404 to user: Instance 343ff586-2029-4b30-ac5f-f827cf95a0ce is not attached to volume ae84a01b-6c0e-48c3-8883-9b26a59eb590 {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:23:58.898301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-62485218-3756-4a24-8983-b8f717afd5db tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments/ae84a01b-6c0e-48c3-8883-9b26a59eb590" status: 404 len: 154 microversion: 2.1 time: 0.089639 Oct 27 01:23:58.904400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 363/741] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:23:58 2021] DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce/os-volume_attachments/ae84a01b-6c0e-48c3-8883-9b26a59eb590 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:23:59.218678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:59.220896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:59.227697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.228396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.229621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.230066 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.313231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:59.313850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:59.320777 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.323759 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.323759 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.323759 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.350959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5674648e-75c7-4123-af93-d51c3af9e62a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 1353 microversion: 2.20 time: 0.132248 Oct 27 01:23:59.350959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 379/742] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:23:59 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 1353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:59.460354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:23:59.467914 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ceee2a81-9660-4af3-b285-7cb9eeb0e394 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.158317 Oct 27 01:23:59.468799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 364/743] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:23:59 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:23:59.565272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:59.566217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:23:59.573092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.573554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.574319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:23:59.574749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:23:59.605358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d671c501-f6b0-412f-a5c1-d3d174eb2a6d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Oct 27 01:23:59.605929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 380/744] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:23:59 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:00.193975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:00.195053 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:00.201758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.202291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.202646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-3ef58c3b-7d14-4f67-b9e7-7cff80146129 req-dfc645ff-3f92-4662-b4c3-b1e5122f8038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffc98f-afa7-4826-8ea3-37f8735364b4", "tag": "3643169c-0e2e-4218-80ef-98b14635f672"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:00.203055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.203478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.205203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:00.205203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:24:00.227895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-3ef58c3b-7d14-4f67-b9e7-7cff80146129 req-dfc645ff-3f92-4662-b4c3-b1e5122f8038 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.228766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-3ef58c3b-7d14-4f67-b9e7-7cff80146129 req-dfc645ff-3f92-4662-b4c3-b1e5122f8038 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.239991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:24:00.240719 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-3ef58c3b-7d14-4f67-b9e7-7cff80146129 req-dfc645ff-3f92-4662-b4c3-b1e5122f8038 service nova] Creating event network-changed:3643169c-0e2e-4218-80ef-98b14635f672 for instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 on hv-cinder-81556 Oct 27 01:24:00.245780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-3ef58c3b-7d14-4f67-b9e7-7cff80146129 req-dfc645ff-3f92-4662-b4c3-b1e5122f8038 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049188 Oct 27 01:24:00.246913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 381/745] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:00.360477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:00.361990 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:00.368213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.368707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.369994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.370455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.467532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b182aa61-6b40-4f37-947e-5b298ea5f406 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 11454 microversion: 2.20 time: 0.111728 Oct 27 01:24:00.468199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 382/746] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:00 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 11454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:00.488570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:00.489739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:00.496612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.498239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.498239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.498239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.584339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9f600630-b802-4a63-bb23-3d6ab9a565c0 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 204 len: 0 microversion: 2.1 time: 0.394556 Oct 27 01:24:00.586670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 365/747] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:24:00 2021] DELETE /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:00.593599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:00.594396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:00.601487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.601933 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.602741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.603166 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.623185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:00.631801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-de2506ff-1ba2-41d1-a10f-cb53745373b1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.147232 Oct 27 01:24:00.632382 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 383/748] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:00 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:00.646595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:00.647561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:00.653457 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.653905 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.654699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:00.655132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:00.684268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-525fb027-9dc6-4935-9cb5-f1b2b49c6cae tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042000 Oct 27 01:24:00.684833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 384/749] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:24:00 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:00.745335 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:00.755877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d2ce5b1e-af0c-43a7-b812-50298e0b257e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1552 microversion: 2.1 time: 0.164702 Oct 27 01:24:00.755877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 366/750] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:00 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:00.799770 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-816059923", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "c89d8d0d-00d8-415f-ae8d-2501c753c88f"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:00.851260 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] validate_networks() for [('c89d8d0d-00d8-415f-ae8d-2501c753c88f', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:24:01.210902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:01.215164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:01.215164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:01.215164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:01.215164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:01.221822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.222298 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.223095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.223526 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.239648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:24:01.243466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Getting quotas for user b35bfb19e59d4f3aa015cb094b2236fd and project 0aca48cc13184200acc3cee83bf4265c. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:24:01.254363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:24:01.256977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:24:01.453802 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f6a6fd4b-de39-4b7d-9e70-5b62ab36c4a6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658367 Oct 27 01:24:01.454481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 385/751] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:24:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:01.464910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d84683ef-85c3-431b-8097-39e63ec594f6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:01.465520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d84683ef-85c3-431b-8097-39e63ec594f6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:01.479771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:01.480753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:01.486871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.487327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.488100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.488537 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.521222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d84683ef-85c3-431b-8097-39e63ec594f6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:01.528538 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d84683ef-85c3-431b-8097-39e63ec594f6 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1217 microversion: 2.1 time: 0.067208 Oct 27 01:24:01.529135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 367/752] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:01 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:01.606185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-19cbb456-29be-454a-9f9b-0d5b597a2f0f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 15792 microversion: 2.20 time: 0.130146 Oct 27 01:24:01.606834 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 386/753] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:01 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 15792 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:01.648861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:01.649467 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:01.655400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.655886 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.656649 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.657076 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.776242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:01.776940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:01.784079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.784525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.785292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:01.785405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:01.785720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:01.792604 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b0293466-d24e-4e4b-8510-e9608952c6e5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.147451 Oct 27 01:24:01.793176 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 368/754] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:01 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:01.913654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:01.921518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-29287f42-abe9-4ccb-9173-faf031342f88 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1552 microversion: 2.1 time: 0.150577 Oct 27 01:24:01.922104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 387/755] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:01 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:02.545163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.545764 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:02.552595 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.553031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.553778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.554232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.614060 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:02.617463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:02.618444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:02.621223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6c89dead-5b76-476f-aa04-aa9a48410714 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1221 microversion: 2.1 time: 0.079606 Oct 27 01:24:02.621752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 369/756] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:02 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:02.630400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.630964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.631769 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.632199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.777640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-63aacad5-20c0-4940-be4c-e2f2452a4d9b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 17861 microversion: 2.20 time: 0.163745 Oct 27 01:24:02.778232 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 388/757] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:02 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 17861 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:02.809802 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.810432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:02.816250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.816685 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.817435 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.817859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.939058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:02.940663 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.941246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:02.947271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-346fe3d6-e270-49b8-9471-8c7ca9a28340 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.141122 Oct 27 01:24:02.947936 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 370/758] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:02 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:02.948476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.948916 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:02.949668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:02.950115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.079340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:03.088619 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1b0a4ad6-9e09-4106-9a04-10b8293beb2e tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1552 microversion: 2.1 time: 0.152360 Oct 27 01:24:03.089209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 389/759] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:02 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:03.593554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-75188baf-0538-45f2-b6ac-571c5ebc6e2d req-2b9d640e-75ee-43c4-99d0-d6f6f657e6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ff586-2029-4b30-ac5f-f827cf95a0ce", "name": "network-vif-deleted", "tag": "d271dfc3-2e52-484f-8433-9676c21da897"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:03.595153 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:03.595153 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:03.605299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-75188baf-0538-45f2-b6ac-571c5ebc6e2d req-2b9d640e-75ee-43c4-99d0-d6f6f657e6c8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.605739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-75188baf-0538-45f2-b6ac-571c5ebc6e2d req-2b9d640e-75ee-43c4-99d0-d6f6f657e6c8 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.616640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-75188baf-0538-45f2-b6ac-571c5ebc6e2d req-2b9d640e-75ee-43c4-99d0-d6f6f657e6c8 service nova] Creating event network-vif-deleted:d271dfc3-2e52-484f-8433-9676c21da897 for instance 343ff586-2029-4b30-ac5f-f827cf95a0ce on hv-cinder-81556 Oct 27 01:24:03.621506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-75188baf-0538-45f2-b6ac-571c5ebc6e2d req-2b9d640e-75ee-43c4-99d0-d6f6f657e6c8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031691 Oct 27 01:24:03.624629 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 371/760] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:03.638224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:03.638831 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:03.645809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.646309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.647071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.647502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.711255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:03.719921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-106b6511-ed27-4c0b-8bf8-f95f335d0ae8 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1269 microversion: 2.1 time: 0.084887 Oct 27 01:24:03.721508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 390/761] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:03 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:03.792415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:03.794831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:03.806641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.808465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.809679 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.811378 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.964750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:03.966399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:03.970523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-09367725-20f0-4166-bcc8-6fdf0b1a9aeb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 19661 microversion: 2.20 time: 0.184102 Oct 27 01:24:03.974997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 372/762] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:03 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 19661 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:03.975113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.975113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:03.975442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:03.975869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.108430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:04.111866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:04.113039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:04.117214 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.117878 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.118838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.119361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.120117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-785c8ba2-4698-4af7-9f03-079ef34998a1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.159620 Oct 27 01:24:04.121003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 391/763] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:03 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:04.151227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.151667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.152104 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lazy-loading 'fault' on Instance uuid 343ff586-2029-4b30-ac5f-f827cf95a0ce {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:04.198301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f2d198479f41a5aede9109c9ae90a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e37607855ec49b6af8f28274acba57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:04.206818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3f58de06-9e70-4304-90ab-725ac81da472 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 200 len: 1348 microversion: 2.1 time: 0.104466 Oct 27 01:24:04.207391 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 373/764] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:04 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:04.737997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:04.741043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:04.744945 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.745385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.746192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.746647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.880282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:04.887378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-77e44e46-ecde-4879-8c23-203d49ef751b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.153522 Oct 27 01:24:04.888020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 392/765] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:04 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:04.982575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:04.983614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:04.990445 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.990810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:04.991577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:04.992005 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.101651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-31c2d33f-44e3-4d2c-b355-209014ebdced tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 21966 microversion: 2.20 time: 0.122879 Oct 27 01:24:05.105724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 374/766] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:04 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 21966 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:05.137415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.138038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:05.144716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.145160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.145918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.146377 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.225031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.226371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] [instance: 343ff586-2029-4b30-ac5f-f827cf95a0ce] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:05.233713 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.234219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.234993 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.235422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.251034 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] HTTP exception thrown: Instance 343ff586-2029-4b30-ac5f-f827cf95a0ce could not be found. Oct 27 01:24:05.252136 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Returning 404 to user: Instance 343ff586-2029-4b30-ac5f-f827cf95a0ce could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:05.253389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4ee67029-19de-420b-b965-67bdef986fff tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce" status: 404 len: 111 microversion: 2.1 time: 0.032843 Oct 27 01:24:05.254166 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 375/767] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:05 2021] GET /compute/v2.1/servers/343ff586-2029-4b30-ac5f-f827cf95a0ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:24:05.263495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-64b31668-3e1b-445e-b38a-e7fc1bec36b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] Calling method '.version_select at 0x7f1d36320d30>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.288103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:05.296331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-63203588-c82c-4cdc-8686-a96c9de2ffb4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.162631 Oct 27 01:24:05.306285 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 393/768] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:05 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:05.357215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-64b31668-3e1b-445e-b38a-e7fc1bec36b9 tempest-TestMinimumBasicScenario-623314913 tempest-TestMinimumBasicScenario-623314913-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1788751962" status: 202 len: 0 microversion: 2.1 time: 0.098242 Oct 27 01:24:05.357963 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 376/769] 10.222.0.32 () {58 vars in 1271 bytes} [Wed Oct 27 01:24:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1788751962 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:05.636252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-11642da0-9af8-4f31-8c38-dae321679be2 req-828ef5e5-c6a9-482f-ac62-1fe0bf3b8ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e62ec14-e607-433f-90ae-db4ee8317198", "tag": "f8c2d635-d80c-468a-920f-2b16de931b30"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:05.637787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:05.637787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:24:05.644606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-11642da0-9af8-4f31-8c38-dae321679be2 req-828ef5e5-c6a9-482f-ac62-1fe0bf3b8ddd service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.645048 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-11642da0-9af8-4f31-8c38-dae321679be2 req-828ef5e5-c6a9-482f-ac62-1fe0bf3b8ddd service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.655738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-11642da0-9af8-4f31-8c38-dae321679be2 req-828ef5e5-c6a9-482f-ac62-1fe0bf3b8ddd service nova] Creating event network-changed:f8c2d635-d80c-468a-920f-2b16de931b30 for instance 1e62ec14-e607-433f-90ae-db4ee8317198 on hv-cinder-81556 Oct 27 01:24:05.661024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-11642da0-9af8-4f31-8c38-dae321679be2 req-828ef5e5-c6a9-482f-ac62-1fe0bf3b8ddd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027833 Oct 27 01:24:05.661024 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 394/770] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:05.904848 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.905531 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:05.913543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.914185 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.915095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.915535 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:05.981457 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-4c8da7f0-017f-44a0-9089-d233f84f7811 req-ff660b13-dbd7-4cdc-927f-a56b7c0b3e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffc98f-afa7-4826-8ea3-37f8735364b4", "name": "network-vif-plugged", "status": "completed", "tag": "3643169c-0e2e-4218-80ef-98b14635f672"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:05.983082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:05.983082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:24:05.997191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-4c8da7f0-017f-44a0-9089-d233f84f7811 req-ff660b13-dbd7-4cdc-927f-a56b7c0b3e11 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:05.997948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-4c8da7f0-017f-44a0-9089-d233f84f7811 req-ff660b13-dbd7-4cdc-927f-a56b7c0b3e11 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:06.014906 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-4c8da7f0-017f-44a0-9089-d233f84f7811 req-ff660b13-dbd7-4cdc-927f-a56b7c0b3e11 service nova] Creating event network-vif-plugged:3643169c-0e2e-4218-80ef-98b14635f672 for instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 on hv-cinder-81556 Oct 27 01:24:06.021128 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-4c8da7f0-017f-44a0-9089-d233f84f7811 req-ff660b13-dbd7-4cdc-927f-a56b7c0b3e11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044734 Oct 27 01:24:06.022313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 395/771] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:24:06.060342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:06.068614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-24a7e14b-9ad3-46d2-9178-208b5d7e6b71 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.167758 Oct 27 01:24:06.069195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 377/772] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:05 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:06.114798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:06.115807 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:06.122340 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:06.123031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:06.124076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:06.124697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:06.237334 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f43b3c23-57a1-4a77-b7b0-e18790ac18d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 23228 microversion: 2.20 time: 0.127879 Oct 27 01:24:06.238283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 396/773] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:06 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 23228 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:06.312587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:06.313099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:06.319202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:06.319616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:06.320374 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:06.320799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:06.449095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:06.457023 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1a3d3e24-a9ae-4067-af2e-7317ceba2e74 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.148134 Oct 27 01:24:06.467875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 378/774] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:06 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:07.086685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:07.087474 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:07.094512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.095042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.095977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.096403 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.226111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:07.234448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-574e69a3-1760-4665-b91b-edba24548698 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.151800 Oct 27 01:24:07.235013 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 397/775] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:07 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:07.249808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:07.251349 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:07.258179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.258585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.259523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.259953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.381906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-067be90e-481e-43d3-a2fc-fb5b3c6196bc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 24279 microversion: 2.20 time: 0.135803 Oct 27 01:24:07.385587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 379/776] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:07 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 24279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:07.474035 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:07.474786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:07.481121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.481637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.482429 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:07.482863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:07.604423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:07.612175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-adc2b6f8-4765-4703-b688-547845a79785 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1362 microversion: 2.1 time: 0.142202 Oct 27 01:24:07.612750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 398/777] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:07 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:08.253358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.253961 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:08.261180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.261642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.262449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.262887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.394201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:08.395628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:08.401860 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.402359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.403384 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.403815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.525009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4921e058-1c7b-449a-b415-29ecc3d8e60f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 25223 microversion: 2.20 time: 0.135734 Oct 27 01:24:08.525953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 399/778] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:08 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 25223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:08.567737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:08.575253 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f40ab948-b8b6-499c-82c0-f493b6a77ecc tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.326885 Oct 27 01:24:08.575828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 380/779] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:08 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:08.629743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.630557 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:08.637617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.638219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.639066 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.639592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.810035 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:08.817721 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cb3f6a3d-b753-4fb5-88cd-8089ae0bba64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1548 microversion: 2.1 time: 0.192743 Oct 27 01:24:08.818326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 400/780] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:08 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:08.835256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.835750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:08.842232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.842679 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.843456 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:08.843910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:08.926440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5fce63d3-764f-4270-8fba-dd23745ac2fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095028 Oct 27 01:24:08.927313 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 381/781] 10.222.0.32 () {58 vars in 1274 bytes} [Wed Oct 27 01:24:08 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:09.537641 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:09.538678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:09.546138 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:09.546822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:09.548255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:09.549426 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:09.592738 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:09.594199 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:09.602042 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:09.602732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:09.604187 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:09.604895 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:09.671238 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-12368c2c-6628-4a85-a271-76966d58338a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 26510 microversion: 2.20 time: 0.136857 Oct 27 01:24:09.677636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 401/782] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:09 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 26510 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:09.910489 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:09.922413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ba3833a9-a45c-4aee-bf79-ba119dd763b2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.333689 Oct 27 01:24:09.932900 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 382/783] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:09 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:10.128401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:10.129039 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-c5375841-a398-45b0-aad5-67d682c280d2 req-24ee8773-a6af-43fb-a3de-3b4a013fb82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffc98f-afa7-4826-8ea3-37f8735364b4", "tag": "3643169c-0e2e-4218-80ef-98b14635f672"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:10.129402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:10.130865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:10.130865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:10.137911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c5375841-a398-45b0-aad5-67d682c280d2 req-24ee8773-a6af-43fb-a3de-3b4a013fb82e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.138502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-c5375841-a398-45b0-aad5-67d682c280d2 req-24ee8773-a6af-43fb-a3de-3b4a013fb82e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.143707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.144155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.144932 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.145365 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.161520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-c5375841-a398-45b0-aad5-67d682c280d2 req-24ee8773-a6af-43fb-a3de-3b4a013fb82e service nova] Creating event network-changed:3643169c-0e2e-4218-80ef-98b14635f672 for instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 on hv-cinder-81556 Oct 27 01:24:10.167343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-c5375841-a398-45b0-aad5-67d682c280d2 req-24ee8773-a6af-43fb-a3de-3b4a013fb82e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041860 Oct 27 01:24:10.168168 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 383/784] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:10.278824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4bce886c-5009-4ced-9718-a0297239212d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.154575 Oct 27 01:24:10.280171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 402/785] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:10 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:10.696689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:10.701134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:10.716022 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.719887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.722426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.731996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.883113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-31a54d90-fe65-44a7-8eb2-45b4fffe3410 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 27388 microversion: 2.20 time: 0.201003 Oct 27 01:24:10.883795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 384/786] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:10 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 27388 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:10.941070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:10.941795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:10.953333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.953829 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:10.958382 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:10.958951 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:11.145107 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:11.155400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8d3238a9-9693-4164-99ab-b6842105d20e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.218879 Oct 27 01:24:11.162420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 403/787] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:10 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:11.292505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:11.294340 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:11.302945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:11.303652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:11.304622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:11.305241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:11.413571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ec57d311-36fb-4a4e-aa26-6d2706fd31a9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.126621 Oct 27 01:24:11.417369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 385/788] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:11 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:11.895617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:11.896591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:11.902712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:11.903155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:11.903913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:11.904343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.022729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eb6d7c60-7f76-41c4-acd1-d11c646ff59d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 27758 microversion: 2.20 time: 0.131063 Oct 27 01:24:12.023620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 404/789] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:11 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 27758 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:12.033514 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-7e32e7a4-7885-4a84-a836-ad94066e6f39 req-307d2674-95d5-4dcc-9594-bd714a94b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e62ec14-e607-433f-90ae-db4ee8317198", "name": "network-vif-plugged", "status": "completed", "tag": "f8c2d635-d80c-468a-920f-2b16de931b30"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:12.038944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:12.038944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:12.043984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-7e32e7a4-7885-4a84-a836-ad94066e6f39 req-307d2674-95d5-4dcc-9594-bd714a94b29e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:12.044425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-7e32e7a4-7885-4a84-a836-ad94066e6f39 req-307d2674-95d5-4dcc-9594-bd714a94b29e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.055420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-7e32e7a4-7885-4a84-a836-ad94066e6f39 req-307d2674-95d5-4dcc-9594-bd714a94b29e service nova] Creating event network-vif-plugged:f8c2d635-d80c-468a-920f-2b16de931b30 for instance 1e62ec14-e607-433f-90ae-db4ee8317198 on hv-cinder-81556 Oct 27 01:24:12.059992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-7e32e7a4-7885-4a84-a836-ad94066e6f39 req-307d2674-95d5-4dcc-9594-bd714a94b29e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Oct 27 01:24:12.060587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 386/790] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:12.175461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:12.176989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:12.184548 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:12.190424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.190424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:12.190424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.425631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:12.426660 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:12.436682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:12.437123 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.437899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:12.438354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:12.538691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-db8d874c-3aaa-417e-baeb-2f0609b181fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.117687 Oct 27 01:24:12.541837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 387/791] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:12 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:24:12.552364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:12.559602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16f492ee-1b6c-4cf6-b92a-6c1a9fd5721c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.388061 Oct 27 01:24:12.560168 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 405/792] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:12 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:13.036025 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:13.036949 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:13.043835 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.044306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.045081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.045515 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.161906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-83e90f29-d7a8-4aaa-9e7d-3d9f1e973667 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28083 microversion: 2.20 time: 0.130277 Oct 27 01:24:13.165761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 388/793] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:13 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28083 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:13.548910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:13.549845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:13.556861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.557494 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.558669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.559615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.579219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:13.580851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:13.589349 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.589890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.590783 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:13.591308 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:13.662667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4928a408-9ec6-49ea-80e2-d891cc7a0bec tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.117371 Oct 27 01:24:13.663286 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 406/794] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:13 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:13.800920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:13.808515 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-90529468-818b-47d9-9bcc-e76a4aefef21 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1317 microversion: 2.1 time: 0.235371 Oct 27 01:24:13.809077 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 389/795] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:13 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:14.174331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:14.175545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:14.182644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.183380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.184145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.184738 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.313563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eae6fc5e-629d-4f71-b36b-232ad33bb0c0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28176 microversion: 2.20 time: 0.143192 Oct 27 01:24:14.315172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 407/796] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:14 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28176 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:14.672626 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:14.674041 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:14.681050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.681477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.682275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.682702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.803245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-737c03ee-e70b-4bd1-96aa-51dea8086c79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.134036 Oct 27 01:24:14.806584 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 390/797] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:14 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:14.825020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:14.826301 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:14.833210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.833832 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.834628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:14.835052 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:14.984742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:14.993332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a61ac574-c2fe-40e7-9c2c-d8e69feaad7c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1507 microversion: 2.1 time: 0.172153 Oct 27 01:24:14.993968 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 408/798] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:14 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:15.325868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:15.326887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:15.334283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:15.334720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:15.335472 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:15.335893 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:15.434117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7d13e22a-925d-4553-9bae-932b6bf155ed tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28176 microversion: 2.20 time: 0.112029 Oct 27 01:24:15.434706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 391/799] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:15 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28176 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:15.814786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:15.816036 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:15.823015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:15.838273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:15.838273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:15.838273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:15.925623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7ac3908e-f3ff-4473-878e-bcae4566ee99 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.114655 Oct 27 01:24:15.928870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 409/800] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:15 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:16.446663 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:16.447568 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:16.454910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.455354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:16.456111 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.456569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:16.566519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2376e6f0-5d39-4dfe-a491-ad7801d10bcc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28466 microversion: 2.20 time: 0.124041 Oct 27 01:24:16.567683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 392/801] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:16 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28466 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:16.614043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fea1112-a5f7-4af3-940b-03efc2a0cd57"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:16.615174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:16.622008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.622505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:16.623267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.623694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:16.937277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:16.938391 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:16.945916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.946393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:16.947294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:16.947725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:17.041541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bfac5c41-10c9-43e9-aa82-bacdd0486a7c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.108326 Oct 27 01:24:17.042475 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 393/802] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:16 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:24:17.491148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ab67dbe2-3741-4eac-8dac-25a03367c0d3 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "POST /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881638 Oct 27 01:24:17.491766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 410/803] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:24:16 2021] POST /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:17.578773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:17.580359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:17.586573 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:17.587143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:17.587962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:17.588455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:17.691721 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d7704460-2387-47a1-bde1-9dd3a66e9d2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28634 microversion: 2.20 time: 0.116943 Oct 27 01:24:17.695585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 394/804] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:17 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28634 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:18.053667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:18.057088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:18.063254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:18.064229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:18.065292 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:18.065737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:18.177032 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9fec7177-4a11-4493-9148-220f41ab39cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.127915 Oct 27 01:24:18.177870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 411/805] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:18 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:18.866669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:18.867714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:18.873756 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:18.874243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:18.875003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:18.875432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:18.974828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-21595682-cfad-4372-97af-4fe8caa1354e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28634 microversion: 2.20 time: 0.275093 Oct 27 01:24:18.975507 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 395/806] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:18 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28634 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:19.294839 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:19.295925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:19.302730 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:19.303174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:19.303957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:19.304401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:19.403437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0c7b0ee8-de46-4778-a61e-fac5eb7a34fc tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.219646 Oct 27 01:24:19.404068 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 412/807] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:19 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:19.988061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:19.989815 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:20.000144 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:20.000818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:20.009543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:20.009992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:20.111929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8a7757d8-5694-41d6-9011-b91400aff113 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28634 microversion: 2.20 time: 0.127420 Oct 27 01:24:20.112741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 396/808] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:19 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28634 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:20.415200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:20.416441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:20.426095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:20.426095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:20.426095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:20.426095 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:20.515083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f4c357db-5fb9-4ae8-87c0-cdf9e18c645e tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.103695 Oct 27 01:24:20.519175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 413/809] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:20 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:24:21.124628 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:21.125641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:21.132887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:21.133339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:21.134156 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:21.134593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:21.260081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3572889e-147c-4b67-81c1-0952f979d11b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 28788 microversion: 2.20 time: 0.139457 Oct 27 01:24:21.260742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 397/810] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:21 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 28788 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:21.527317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:21.528312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:21.536049 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:21.536707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:21.537476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:21.537901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:21.630329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-14023950-ecbc-4935-9dc9-80bf6f826994 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.106947 Oct 27 01:24:21.633545 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 414/811] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:21 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:22.272209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:22.273228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:22.280296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:22.280739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:22.285197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:22.285197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:22.400417 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7b967853-43bb-412e-a43d-2bc0075a9f53 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 30523 microversion: 2.20 time: 0.132003 Oct 27 01:24:22.401928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 398/812] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:22 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 30523 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:22.641010 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:22.642932 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:22.649481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:22.649923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:22.650899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:22.651333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:22.753913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-51bf94c9-8c8b-431d-83e3-19e556fe4de2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 14 microversion: 2.1 time: 0.116338 Oct 27 01:24:22.756909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 415/813] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:22 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:24:23.414696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:23.415789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:23.422644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:23.423344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:23.424128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:23.424561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:23.525483 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-73fb95fd-84f8-4011-8bcb-7cb6d668c0f6 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 31840 microversion: 2.20 time: 0.114938 Oct 27 01:24:23.526339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 399/814] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:23 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 31840 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:23.782288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:23.783897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:23.791973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:23.792611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:23.793565 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:23.794180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:23.925960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d286a5d4-03e1-47a8-8102-e4b872c365e3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 9751 microversion: 2.1 time: 0.163962 Oct 27 01:24:23.929627 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 416/815] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:23 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 9751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:24.538407 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:24.539394 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:24.546424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:24.546874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:24.547729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:24.548165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:24.687234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c74c06e6-6e03-43e9-91d5-c88616e84749 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 32868 microversion: 2.20 time: 0.152967 Oct 27 01:24:24.687903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 400/816] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:24 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 32868 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:24.937550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:24.938653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:24.946447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:24.946892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:24.947664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:24.948092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:25.057361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3d8ea04e-824e-4543-bc09-9c9a4fd88a79 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 15025 microversion: 2.1 time: 0.123625 Oct 27 01:24:25.058005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 417/817] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:24 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 15025 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:25.699630 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:25.701460 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:25.708105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:25.708860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:25.709701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:25.710265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:25.833096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-55f1b2ee-1b79-4c05-8027-b58505625a5f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 33511 microversion: 2.20 time: 0.137255 Oct 27 01:24:25.838689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 401/818] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:25 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 33511 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:26.069936 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:26.071750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:26.079536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.080268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.081144 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.081674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.193052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:26.193638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:26.200689 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.200857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b88309a6-ecc4-44c8-815b-5ecff540e719 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 18056 microversion: 2.1 time: 0.135311 Oct 27 01:24:26.201130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.201583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 418/819] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:26 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 18056 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:26.201892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.202458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.305645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'services' on Instance uuid 1e62ec14-e607-433f-90ae-db4ee8317198 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:26.676200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8bf55b91-ed83-4833-b764-e1f087bd6b94 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments/4fea1112-a5f7-4af3-940b-03efc2a0cd57" status: 202 len: 0 microversion: 2.1 time: 0.486761 Oct 27 01:24:26.741564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 402/820] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:24:26 2021] DELETE /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments/4fea1112-a5f7-4af3-940b-03efc2a0cd57 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:26.743106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:26.743106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:26.746427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.747061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.748006 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.748624 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.795250 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-71bf52b0-636a-441b-81b9-fcb4ccfa3f31 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061677 Oct 27 01:24:26.796623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 419/821] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:24:26 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:26.848920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:26.850386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:26.858129 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.858758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.859675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:26.860199 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:26.980891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-541a196c-a489-4246-b1d7-22ef9743a375 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 34253 microversion: 2.20 time: 0.137851 Oct 27 01:24:26.984925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 403/822] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:26 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 34253 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:27.214097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:27.216078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:27.224388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:27.225195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:27.226376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:27.227050 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:27.348577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fd25b082-70d7-41be-ab45-420bc06dbf43 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 19342 microversion: 2.1 time: 0.138963 Oct 27 01:24:27.353203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 420/823] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:27 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 19342 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:27.809560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:27.818844 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:27.831455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:27.831903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:27.832952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:27.833551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:27.912783 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c3c6569d-d74d-4701-8968-3a4380a1695e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107550 Oct 27 01:24:27.913613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 404/824] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:24:27 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:27.993385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:27.994852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:28.001821 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.002557 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.004116 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.004712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.133461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8d46959d-bd6c-406a-87dd-df94413bf951 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 35127 microversion: 2.20 time: 0.143422 Oct 27 01:24:28.135987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 421/825] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:27 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 35127 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:28.359972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:28.361765 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:28.367992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.368431 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.369241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.369667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.482921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2df6e0d6-fbe1-451c-828f-ee0bd38c857d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 21338 microversion: 2.1 time: 0.126467 Oct 27 01:24:28.487776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 405/826] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:28 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 21338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:28.925207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:28.927849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:28.935879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.936646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.938191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:28.938959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:28.991461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1dae1a38-927a-48c6-90b9-54d8d15734f2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070710 Oct 27 01:24:28.992219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 422/827] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:24:28 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:24:29.147908 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:29.149796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:29.157143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:29.157833 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:29.158836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:29.159506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:29.282887 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1ca528ba-10d4-4975-ae28-32f5d5138e3f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 36142 microversion: 2.20 time: 0.136555 Oct 27 01:24:29.284157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 406/828] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:29 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 36142 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:29.495767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:29.496921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:29.504840 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:29.505509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:29.506530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:29.507182 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:29.612247 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-76f245b7-d422-401a-b379-cc44a979c512 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 22942 microversion: 2.1 time: 0.120039 Oct 27 01:24:29.613502 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 423/829] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:29 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 22942 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:30.296075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:30.297183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:30.304868 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.305306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.306322 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.306751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.373323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:30.373913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:30.381447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.381889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.382893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.383322 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.415268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:24:30.415823 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2788b029-280b-42ac-8a18-a6ea8ccfc23b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 37131 microversion: 2.20 time: 0.123594 Oct 27 01:24:30.417498 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 407/830] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:30 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 37131 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:30.625137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:30.626760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:30.635577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.636017 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.636777 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.637195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.740652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4e97521c-c8ee-4e7e-99e9-76a7329515d1 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 204 len: 0 microversion: 2.1 time: 0.371245 Oct 27 01:24:30.742162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 424/831] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:24:30 2021] DELETE /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:30.747955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c57d0d0e-a32a-4eda-9c68-4af7f710eee9 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 23797 microversion: 2.1 time: 0.126683 Oct 27 01:24:30.748614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 408/832] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:30 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 23797 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:30.752950 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:30.753875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:30.765509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.767199 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.774061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:30.774061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:30.922224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:30.931673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-01cbb740-604e-4923-903b-a3da7bf1ec9e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1513 microversion: 2.1 time: 0.185132 Oct 27 01:24:30.932449 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 425/833] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:30 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:31.284464 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Action: 'create', calling method: .version_select at 0x7f1d361e20d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1671639713"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:31.303841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:24:31.307692 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for user af5e8cd9e794460f805ce9e5b70edd32 and project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:24:31.427797 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:31.428760 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:31.435118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.435563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:31.436319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.436748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:31.554108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-de0e1479-1197-499c-a1ec-3edeca4f41f5 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 38073 microversion: 2.20 time: 0.129776 Oct 27 01:24:31.554871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 426/834] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:31 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 38073 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:31.645356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:24:31.649351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for user af5e8cd9e794460f805ce9e5b70edd32 and project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:24:31.663519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a36cb6d3-8e33-40d7-bb27-57c2ec516b49 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.541526 Oct 27 01:24:31.664137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 409/835] 10.222.0.32 () {60 vars in 1157 bytes} [Wed Oct 27 01:24:31 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:31.762938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:31.764192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:31.772299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.772974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:31.774281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.774784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:31.895192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9eedb24d-812f-45ec-82f1-d28bb41184c6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 24840 microversion: 2.1 time: 0.137685 Oct 27 01:24:31.895835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 427/836] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:31 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 24840 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:31.948854 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:31.949926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:31.959608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.960117 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:31.961607 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:31.962314 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:32.092423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:32.103376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5af43f53-7070-400f-8fe4-7627d0179279 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1513 microversion: 2.1 time: 0.158275 Oct 27 01:24:32.104100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 410/837] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:31 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:32.566356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:32.567344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:32.574207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:32.574647 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:32.575536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:32.575985 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:32.723986 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b5541273-6ac1-4674-8b50-35e7971ebcbf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 38178 microversion: 2.20 time: 0.161609 Oct 27 01:24:32.728331 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 428/838] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:32 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 38178 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:32.907395 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:32.908359 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:32.914622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:32.915070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:32.915828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:32.916264 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.026478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-95379133-7877-4b04-836f-60db58d9b5cb tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 25908 microversion: 2.1 time: 0.123009 Oct 27 01:24:33.027525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 411/839] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:32 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 25908 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:33.121605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:33.122506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:33.129890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:33.133424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.133424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:33.133424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.274270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:33.281587 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e721f88f-9554-4848-81a1-b49bce1124af tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1513 microversion: 2.1 time: 0.163970 Oct 27 01:24:33.282477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 429/840] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:33 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:33.597363 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-02c9625d-1098-4141-b0db-11871cdc0310 req-1d3a4c45-3fce-41c8-89f5-68c32f2e1859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e62ec14-e607-433f-90ae-db4ee8317198", "name": "network-vif-deleted", "tag": "f8c2d635-d80c-468a-920f-2b16de931b30"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:33.599237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:33.599237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:33.607608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-02c9625d-1098-4141-b0db-11871cdc0310 req-1d3a4c45-3fce-41c8-89f5-68c32f2e1859 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:33.608105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-02c9625d-1098-4141-b0db-11871cdc0310 req-1d3a4c45-3fce-41c8-89f5-68c32f2e1859 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.621947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-02c9625d-1098-4141-b0db-11871cdc0310 req-1d3a4c45-3fce-41c8-89f5-68c32f2e1859 service nova] Creating event network-vif-deleted:f8c2d635-d80c-468a-920f-2b16de931b30 for instance 1e62ec14-e607-433f-90ae-db4ee8317198 on hv-cinder-81556 Oct 27 01:24:33.628890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-02c9625d-1098-4141-b0db-11871cdc0310 req-1d3a4c45-3fce-41c8-89f5-68c32f2e1859 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035801 Oct 27 01:24:33.629592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 412/841] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:33.736623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:33.737575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:33.760674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:33.760674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.760674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:33.770202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:33.870281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-760da8c8-d28f-4df5-99dd-a2ce48ed1e52 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 38178 microversion: 2.20 time: 0.137558 Oct 27 01:24:33.871268 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 430/842] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:33 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 38178 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:34.046616 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:34.048692 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:34.054809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.055283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.056065 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.056499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.161942 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-65152f4c-c7a5-431d-9ffe-0e183b1dc271 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 27070 microversion: 2.1 time: 0.121095 Oct 27 01:24:34.165925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 413/843] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:34 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 27070 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:34.299522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:34.300218 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:34.312209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.312650 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.313940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.314522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.347904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.348353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.348835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'fault' on Instance uuid 1e62ec14-e607-433f-90ae-db4ee8317198 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:34.396380 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:34.403781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f6553300-258c-4cde-9448-1cca6d741de7 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 200 len: 1307 microversion: 2.1 time: 0.108712 Oct 27 01:24:34.404535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 431/844] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:34 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:34.883289 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:34.884567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:34.892165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.892757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.893712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:34.903870 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:34.993711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e5ac5468-e7d5-49bc-9cf5-cf4e1d0a5ae2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 200 len: 38317 microversion: 2.20 time: 0.114303 Oct 27 01:24:34.994673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 414/845] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:34 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 38317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:35.007318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:35.007837 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:35.017536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.022007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.022007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.022007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.044533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-124d16ab-a337-4256-8543-b3fac0211ba8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/ips" status: 200 len: 152 microversion: 2.20 time: 0.041755 Oct 27 01:24:35.045119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 432/846] 10.222.0.32 () {60 vars in 1288 bytes} [Wed Oct 27 01:24:35 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:35.175047 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:35.176197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:35.188687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.188687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.188687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.188687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.290861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-133aeb01-6143-4f00-ba94-759958ca49f4 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 27757 microversion: 2.1 time: 0.121514 Oct 27 01:24:35.291751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 415/847] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:35 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 27757 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:35.420736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:35.421378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 1e62ec14-e607-433f-90ae-db4ee8317198] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:35.428345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.428842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.430068 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:35.446333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:35.468484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Instance 1e62ec14-e607-433f-90ae-db4ee8317198 could not be found. Oct 27 01:24:35.469087 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 404 to user: Instance 1e62ec14-e607-433f-90ae-db4ee8317198 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:35.471732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-323eaf69-63fd-477e-bc3e-eafc96734cd2 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198" status: 404 len: 111 microversion: 2.1 time: 0.054830 Oct 27 01:24:35.472563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 433/848] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:35 2021] GET /compute/v2.1/servers/1e62ec14-e607-433f-90ae-db4ee8317198 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:36.303594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:36.304604 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:36.313181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:36.313181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:36.313995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:36.314496 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:36.416404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-29305a5e-f515-47ef-a77e-63d9d95aaee3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28188 microversion: 2.1 time: 0.117076 Oct 27 01:24:36.420733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 416/849] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:36 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:37.025139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:37.025618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:37.032114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.032560 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.033364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.033791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.058918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:24:37.372036 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bc0472b2-3d2a-4d67-94d6-629123f0d38d tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 204 len: 0 microversion: 2.1 time: 0.350264 Oct 27 01:24:37.372744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 434/850] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:24:37 2021] DELETE /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:37.381235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:37.381923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:37.388684 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.389122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.389888 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.390348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.429258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:37.430530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:37.436554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.437001 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.437826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.438302 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.513653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:37.521917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6bfdcd34-fc18-45ca-a744-10350234723c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1515 microversion: 2.1 time: 0.144687 Oct 27 01:24:37.522528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 417/851] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:37 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:37.538489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0c9df05d-2bd4-43b8-9dd0-da583461c1f1 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28188 microversion: 2.1 time: 0.112985 Oct 27 01:24:37.539124 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 435/852] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:37 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:37.864935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:37.865381 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:37.871532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.871970 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.872719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:37.873177 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:37.895485 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lazy-loading 'flavor' on Instance uuid 22168f93-be95-4a0a-ba03-afbae82e5931 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:38.495064 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-73cc0659-8d45-4d0d-8f46-b4504c1f5d7a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 202 len: 0 microversion: 2.20 time: 0.633823 Oct 27 01:24:38.495763 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 418/853] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:24:37 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:38.504816 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:38.505542 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:38.512308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.512758 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.513518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.513973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.538723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:38.539752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:38.545935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.546413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.547745 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.548283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.704659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.709254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.713925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.722521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.722657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2f3504e3-4aaa-4c91-a725-e4ee79bb8470 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1515 microversion: 2.1 time: 0.181828 Oct 27 01:24:38.722747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cf31e0b9-facd-41c3-b919-3bc8ae9df3e0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.216695 Oct 27 01:24:38.722827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 419/854] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:38 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:38.722928 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 436/855] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:38 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:38.723016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:38.723016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:38.728455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.728917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.729663 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:38.730116 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:38.877435 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9c1708b8-67be-43db-8e82-d3db57971625 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28315 microversion: 2.1 time: 0.159240 Oct 27 01:24:38.878096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 420/856] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:38 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:39.736959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.737752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:39.740252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.744266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:39.746225 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.746723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:39.747465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.747900 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:39.751130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.751642 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:39.752535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.753084 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:39.934742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.940264 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.942764 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.944236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.945377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-46b5abf7-5361-49e0-8407-487e7c8d77ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.213226 Oct 27 01:24:39.945929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 421/857] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:39 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:24:39.947517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9d0e19b4-99b2-4750-b8e0-f87da1d2c231 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1515 microversion: 2.1 time: 0.211564 Oct 27 01:24:39.948229 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 437/858] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:39 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:39.950605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:39.951506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:39.957880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.958356 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:39.959114 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:39.959537 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:40.059938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9a1c15a5-e88d-47f7-841c-1d8c97bc2a89 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28479 microversion: 2.1 time: 0.112447 Oct 27 01:24:40.061131 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 422/859] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:39 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28479 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:40.158135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-4642fd59-5209-4a63-97bd-cf21e69448c1 req-4ad5c663-606f-41ba-9743-2af88c3fa401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ef3a98-3711-4393-a080-0660ad63f97c", "name": "network-vif-deleted", "tag": "ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:40.168896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:40.168896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:24:40.176809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-4642fd59-5209-4a63-97bd-cf21e69448c1 req-4ad5c663-606f-41ba-9743-2af88c3fa401 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:40.177254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-4642fd59-5209-4a63-97bd-cf21e69448c1 req-4ad5c663-606f-41ba-9743-2af88c3fa401 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:40.188773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-4642fd59-5209-4a63-97bd-cf21e69448c1 req-4ad5c663-606f-41ba-9743-2af88c3fa401 service nova] Creating event network-vif-deleted:ec46c2c6-aa22-4cd6-9fec-a72909d9d2b4 for instance e9ef3a98-3711-4393-a080-0660ad63f97c on hv-cinder-81556 Oct 27 01:24:40.193909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-4642fd59-5209-4a63-97bd-cf21e69448c1 req-4ad5c663-606f-41ba-9743-2af88c3fa401 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100501 Oct 27 01:24:40.194780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 438/860] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:40.965006 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:40.965687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:40.968368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:40.969628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:40.973217 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:40.973657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:40.974439 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:40.974865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:40.975515 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:40.975962 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:40.976715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:40.977143 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:41.006732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:41.007200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:41.007640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'fault' on Instance uuid e9ef3a98-3711-4393-a080-0660ad63f97c {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:41.073769 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.083069 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ea4579b2-c029-44a2-bda4-471622177b39 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 200 len: 1308 microversion: 2.1 time: 0.121945 Oct 27 01:24:41.083653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 423/861] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:40 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:41.088171 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:41.089222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:41.099943 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:41.100709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:41.101827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:41.102840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:41.145398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.154405 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.156054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.157432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-39997bab-3dc0-40be-941e-eab50c7e065d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.193749 Oct 27 01:24:41.157974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 439/862] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:40 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:24:41.227955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-61a1ac62-f98d-4f1d-a8df-fa99e4bd8b86 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28647 microversion: 2.1 time: 0.142763 Oct 27 01:24:41.228605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 424/863] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:41 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:42.100809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.101522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: e9ef3a98-3711-4393-a080-0660ad63f97c] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:42.108009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.108453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.109208 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.110420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.122964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Instance e9ef3a98-3711-4393-a080-0660ad63f97c could not be found. Oct 27 01:24:42.123541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 404 to user: Instance e9ef3a98-3711-4393-a080-0660ad63f97c could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:42.124345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1e4c5e7f-087d-401e-8db9-3d2611248ade tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c" status: 404 len: 111 microversion: 2.1 time: 0.027312 Oct 27 01:24:42.124855 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 440/864] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:42 2021] GET /compute/v2.1/servers/e9ef3a98-3711-4393-a080-0660ad63f97c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:42.133165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.133744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:42.140535 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.141523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.142582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.143021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.168830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:24:42.186611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.188725 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:42.194146 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.194702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.195590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.196123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.317369 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.325005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.326513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.327654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a7be0cc6-4aa6-4fcf-8453-6ee94776a00a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.145035 Oct 27 01:24:42.328195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 441/865] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:42 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:42.333318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:42.335385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:42.339631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.340072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.340837 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.341249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.447800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4aef5338-25d0-4f73-b57a-43b1a74b8717 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28647 microversion: 2.1 time: 0.117626 Oct 27 01:24:42.448438 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 442/866] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:42 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28647 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:42.474752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-72c23370-5605-4c71-935b-2069c9d8054a tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 204 len: 0 microversion: 2.1 time: 0.345183 Oct 27 01:24:42.475321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 425/867] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:24:42 2021] DELETE /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:42.483511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.484529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:42.491258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.491701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.492482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:42.492904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:42.616317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.623856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9738d874-7e9d-43c9-84fe-03ec317d2eb9 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1513 microversion: 2.1 time: 0.144191 Oct 27 01:24:42.624404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 443/868] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:42 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:43.347018 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.347614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:43.354835 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.355273 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.356052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.356477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.459945 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:43.460925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:43.467126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.467575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.468345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.468779 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.474973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.483112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.484627 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.485773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1b5f9ac5-ee5d-4896-9798-5444612d03cd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.142953 Oct 27 01:24:43.486352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 426/869] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:43 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:43.572657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c2c98b56-b329-4b71-b462-e51e92344516 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28647 microversion: 2.1 time: 0.116092 Oct 27 01:24:43.574134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 444/870] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:43 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28647 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:43.640357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.641075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:43.646855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.647302 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.648060 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:43.648494 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:43.767428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.774669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-38853a87-fcbc-47ff-ba7e-ca7cebef6f4e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1513 microversion: 2.1 time: 0.138033 Oct 27 01:24:43.775235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 427/871] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:43 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:44.505234 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.505972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:44.512571 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.513015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.513777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.514242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.584633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:44.586089 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:44.592780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.593219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.594228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.594670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.650884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.659405 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.660886 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.662115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d4e991ec-0183-49bd-9704-bce449118fdb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.161859 Oct 27 01:24:44.662673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 445/872] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:44 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:44.709792 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0741919c-40e5-4d26-9a93-e302e5a21d1d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 28647 microversion: 2.1 time: 0.128730 Oct 27 01:24:44.710482 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 428/873] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:44 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 28647 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:44.790677 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.791195 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:44.800005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.800448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.801320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:44.801771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:44.941388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.948793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c91036a3-164f-4025-bad2-c3a0f0f11e00 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1513 microversion: 2.1 time: 0.161703 Oct 27 01:24:44.950784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 446/874] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:44 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:45.179617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-44574892-9c50-450a-9203-9e23e9f30c40 req-3971c2c7-c8fe-47d1-857a-3527a63d376b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad358cb-e3ad-4b49-8030-2e357c401601", "name": "network-vif-deleted", "tag": "53ddad0e-9508-4aac-a462-30949e2d214b"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:45.181084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:45.181084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:45.189526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-44574892-9c50-450a-9203-9e23e9f30c40 req-3971c2c7-c8fe-47d1-857a-3527a63d376b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.190148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-44574892-9c50-450a-9203-9e23e9f30c40 req-3971c2c7-c8fe-47d1-857a-3527a63d376b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.200913 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-44574892-9c50-450a-9203-9e23e9f30c40 req-3971c2c7-c8fe-47d1-857a-3527a63d376b service nova] Creating event network-vif-deleted:53ddad0e-9508-4aac-a462-30949e2d214b for instance dad358cb-e3ad-4b49-8030-2e357c401601 on hv-cinder-81556 Oct 27 01:24:45.206318 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-44574892-9c50-450a-9203-9e23e9f30c40 req-3971c2c7-c8fe-47d1-857a-3527a63d376b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030669 Oct 27 01:24:45.206970 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 429/875] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:24:45.681080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:45.681679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:45.688480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.689225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.689972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.690425 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.722543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:45.723554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:45.729767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.730254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.731013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.731439 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.819373 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:45.826972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:45.829099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:45.830295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7d789473-bc1b-4825-8adf-ff5de2a8a6e8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.152919 Oct 27 01:24:45.830851 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 447/876] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:45 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:45.845747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-714d7f78-09a3-41bb-b0fe-4b5bf973d055 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 29388 microversion: 2.1 time: 0.127497 Oct 27 01:24:45.846518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 430/877] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:45 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 29388 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:45.970237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:45.970834 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:45.976676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.977115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:45.978142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:45.978569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.015022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:46.015475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.016146 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'fault' on Instance uuid dad358cb-e3ad-4b49-8030-2e357c401601 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:46.060440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.068215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-664d1cf9-e981-4d63-a0b5-b84031f5ae93 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 200 len: 1307 microversion: 2.1 time: 0.101875 Oct 27 01:24:46.068782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 448/878] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:45 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:46.849837 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:46.850592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:46.857537 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:46.858255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:46.858652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.859545 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:46.860024 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.860308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:46.867090 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:46.867536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.868307 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:46.868798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:46.971021 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c55acf8b-a060-4398-95fa-ea23fd67b3c3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 31298 microversion: 2.1 time: 0.117217 Oct 27 01:24:46.975086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 449/879] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:46 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 31298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:46.983279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.991286 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.992779 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.993928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8a721a3b-d736-4256-bfb7-9f92fb0dac6f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.148543 Oct 27 01:24:46.994507 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 431/880] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:46 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:47.093818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:47.094721 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: dad358cb-e3ad-4b49-8030-2e357c401601] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:47.101413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:47.101850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:47.102902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:47.103369 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:47.118566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Instance dad358cb-e3ad-4b49-8030-2e357c401601 could not be found. Oct 27 01:24:47.119175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 404 to user: Instance dad358cb-e3ad-4b49-8030-2e357c401601 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:47.120053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-00c0d638-295e-459f-b214-28edcb3abf7b tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601" status: 404 len: 111 microversion: 2.1 time: 0.030304 Oct 27 01:24:47.120844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 450/881] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:47 2021] GET /compute/v2.1/servers/dad358cb-e3ad-4b49-8030-2e357c401601 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:47.986075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:47.987007 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:47.994909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:47.995355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:47.996189 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:47.996619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.012820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.013585 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:48.024817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.025638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.026871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.027678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.096137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b081f06b-3a2b-44d7-9fdc-e442dfc6d1d7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 32796 microversion: 2.1 time: 0.116128 Oct 27 01:24:48.096806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 432/882] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:47 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 32796 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:48.172136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.180119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.181688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.182874 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9f09dbb4-3040-4f47-8a2e-82bf3f932aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.173908 Oct 27 01:24:48.183417 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 451/883] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:48 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:48.417633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.418277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:48.425078 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.425515 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.426299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.426729 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.451480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:24:48.807340 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8a3f7172-43f9-4816-885d-2a4dc38f6447 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "DELETE /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 204 len: 0 microversion: 2.1 time: 0.393158 Oct 27 01:24:48.808195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 433/884] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:24:48 2021] DELETE /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:24:48.818668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.819377 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:48.826410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.826854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.827631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:48.828230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:48.949975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.957518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4e7586dc-ae4f-44b3-9348-5fe5f92f4d1c tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1514 microversion: 2.1 time: 0.143622 Oct 27 01:24:48.958099 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 452/885] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:48 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:49.110133 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:49.111207 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:49.118208 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.118658 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:49.119463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.119892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:49.202549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.203216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:49.209351 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.209786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:49.210576 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.211009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:49.219449 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f62874d8-88bf-4ae4-87b7-d9a2a85f9a32 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 33572 microversion: 2.1 time: 0.113740 Oct 27 01:24:49.220229 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 434/886] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:49 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 33572 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:49.338557 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:49.346703 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:49.348192 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:49.349337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7caf0c99-9d94-4f9f-b18d-6ceb4984f4eb tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.150479 Oct 27 01:24:49.349896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 453/887] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:49 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:24:49.975079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.975775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:49.983010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.983463 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:49.984271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:49.984723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:50.110597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.117830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c291f74a-2043-4793-a030-5a9f9027dd70 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1514 microversion: 2.1 time: 0.146830 Oct 27 01:24:50.118421 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 435/888] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:49 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:50.230931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:50.231938 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:50.238168 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:50.238637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:50.239517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:50.239954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:50.360862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fec29944-d33f-43a0-a27e-fd4258f6c8e8 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 34062 microversion: 2.1 time: 0.133601 Oct 27 01:24:50.362546 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 454/889] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:50 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 34062 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:50.367795 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:50.368511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:50.374758 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:50.375847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:50.376946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:50.377371 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:50.501015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.509061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.510544 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.511680 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-38a06b2c-33ab-430e-a4b5-35ebb3c6410e tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1744 microversion: 2.20 time: 0.147614 Oct 27 01:24:50.512231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 436/890] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:50 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:51.135953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:51.136566 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:51.143949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.144397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.145152 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.145578 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.265311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.274604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9e9940ee-6e23-4c79-bae3-fb50f55fbbda tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1514 microversion: 2.1 time: 0.142688 Oct 27 01:24:51.275505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 455/891] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:51 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:51.373287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:51.374342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:51.381119 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.381567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.382447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.382890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.512402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f86d7943-7155-41e6-a71f-d79c912b49fa tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 34664 microversion: 2.1 time: 0.143070 Oct 27 01:24:51.513486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 437/892] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:51 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 34664 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:51.530353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:51.531774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:51.538491 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.539153 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.540072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.540503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.673822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.676827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.678362 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.679520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-777503c5-cc85-4fdc-8f94-64478a922cdd tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.153051 Oct 27 01:24:51.680067 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 456/893] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:51 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:51.813306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-7c3790ee-51ed-4864-a24e-1af5d06eab6d req-27452b11-9387-489c-8ff4-39414a227083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c63b91-4304-474a-a244-d87f58ccf234", "name": "network-vif-deleted", "tag": "3c2e10e7-5f1e-4d8b-8f85-8ee84618befe"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:51.814896 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:51.814896 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:24:51.822733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-7c3790ee-51ed-4864-a24e-1af5d06eab6d req-27452b11-9387-489c-8ff4-39414a227083 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:51.823520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-7c3790ee-51ed-4864-a24e-1af5d06eab6d req-27452b11-9387-489c-8ff4-39414a227083 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:51.835203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-7c3790ee-51ed-4864-a24e-1af5d06eab6d req-27452b11-9387-489c-8ff4-39414a227083 service nova] Creating event network-vif-deleted:3c2e10e7-5f1e-4d8b-8f85-8ee84618befe for instance 04c63b91-4304-474a-a244-d87f58ccf234 on hv-cinder-81556 Oct 27 01:24:51.839925 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-7c3790ee-51ed-4864-a24e-1af5d06eab6d req-27452b11-9387-489c-8ff4-39414a227083 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Oct 27 01:24:51.840510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 438/894] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:52.148918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-a5085b57-c07f-4581-8edc-11dbd894b1d7 req-f5a72ed4-2ef9-4346-8b9e-96204411a485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "name": "network-vif-plugged", "status": "completed", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:52.150511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:24:52.150511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:24:52.158074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-a5085b57-c07f-4581-8edc-11dbd894b1d7 req-f5a72ed4-2ef9-4346-8b9e-96204411a485 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.158517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-a5085b57-c07f-4581-8edc-11dbd894b1d7 req-f5a72ed4-2ef9-4346-8b9e-96204411a485 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.169068 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-a5085b57-c07f-4581-8edc-11dbd894b1d7 req-f5a72ed4-2ef9-4346-8b9e-96204411a485 service nova] Creating event network-vif-plugged:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:24:52.174624 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-a5085b57-c07f-4581-8edc-11dbd894b1d7 req-f5a72ed4-2ef9-4346-8b9e-96204411a485 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085448 Oct 27 01:24:52.174624 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 457/895] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:24:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:52.293585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.294692 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:52.301760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.304102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.304102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.304741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.338267 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.339313 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.339891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lazy-loading 'fault' on Instance uuid 04c63b91-4304-474a-a244-d87f58ccf234 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:24:52.395842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35bfb19e59d4f3aa015cb094b2236fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aca48cc13184200acc3cee83bf4265c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:52.404494 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f75b3899-3b0e-45d4-866a-5a8879c0ac7e tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 200 len: 1308 microversion: 2.1 time: 0.115454 Oct 27 01:24:52.405441 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 439/896] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:52 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:52.524291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:52.525356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:52.532997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.533714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.535076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.535771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.652255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cc4db333-a5c4-4458-84f4-e0c8039cf73f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 35367 microversion: 2.1 time: 0.131991 Oct 27 01:24:52.657376 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 458/897] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:52 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 35367 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:52.699940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.700585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:52.709953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.710425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:52.711205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:52.711736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:53.120222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.130366 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.132098 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.133264 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-76938829-6ef3-44c8-b7ed-43acdd1773ea tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.437369 Oct 27 01:24:53.133810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 440/898] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:52 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:53.422477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:53.423404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] [instance: 04c63b91-4304-474a-a244-d87f58ccf234] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:53.430485 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:53.430934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:53.431694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:53.432126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:53.447290 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] HTTP exception thrown: Instance 04c63b91-4304-474a-a244-d87f58ccf234 could not be found. Oct 27 01:24:53.447876 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] Returning 404 to user: Instance 04c63b91-4304-474a-a244-d87f58ccf234 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:53.448687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e2c91426-3ade-41e9-b4d2-0de9e6313a48 tempest-AttachVolumeNegativeTest-447832540 tempest-AttachVolumeNegativeTest-447832540-project] 10.222.0.32 "GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234" status: 404 len: 111 microversion: 2.1 time: 0.031026 Oct 27 01:24:53.449215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 459/899] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:53 2021] GET /compute/v2.1/servers/04c63b91-4304-474a-a244-d87f58ccf234 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:53.664523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:53.665426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:53.672231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:53.672830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:53.673512 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:53.673942 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:53.769048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e5fc8b8d-4805-4670-abd2-bf7c57dac6a5 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 36596 microversion: 2.1 time: 0.107956 Oct 27 01:24:53.773280 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 441/900] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:53 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 36596 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:54.152157 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:54.152765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:54.159763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:54.164262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:54.164262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:54.164262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:54.300937 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:54.309445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:54.311258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:54.312456 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e51afca6-3691-44dd-952d-9a4e80ab43a3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.163960 Oct 27 01:24:54.313007 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 460/901] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:54 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:54.782481 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:54.784259 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:54.792369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:54.792774 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:54.793517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:54.795775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:54.899883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d8fdb05b-8bd3-4268-bda0-83a3c25f4204 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 37861 microversion: 2.1 time: 0.122014 Oct 27 01:24:54.902926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 442/902] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:54 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 37861 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:55.331423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:55.332801 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:55.340202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:55.340778 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:55.341589 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:55.341988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:55.511058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:55.521472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:55.523460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:55.524887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b35582c3-08c2-455f-8043-762f91005cdc tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.198104 Oct 27 01:24:55.530482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 461/903] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:55 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:55.906720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-852509308", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1671639713", "security_groups": [{"name": "tempest-secgroup-smoke-391808001"}], "networks": [{"uuid": "2042b203-b5b7-49f8-8939-5ca2d9affb39"}], "block_device_mapping_v2": [{"uuid": "93c33d2f-7a5e-44c0-a7f4-1ff7072080a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:55.917385 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:55.919141 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:55.934122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:55.934122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:55.934122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:55.934122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:56.031822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] validate_networks() for [('2042b203-b5b7-49f8-8939-5ca2d9affb39', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:24:56.036908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c3c94ead-84c8-4a6a-8834-9f130c92f37c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 38178 microversion: 2.1 time: 0.125082 Oct 27 01:24:56.041777 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 462/904] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:55 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 38178 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:56.162137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ad9b724d-c852-499b-a635-b9e9dbe89e98 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Action: 'create', calling method: .version_select at 0x7f1d361f6c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-171180320", "metadata": {"Type": "work"}}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:56.514728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:56.515141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:56.515602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:56.516004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:56.516411 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:56.528268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:56.529028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:56.530072 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:56.531290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:56.549754 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:24:56.554576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Getting quotas for user af5e8cd9e794460f805ce9e5b70edd32 and project 71d6d08d1ae14a628663fb4124cfccc2. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:24:56.628142 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:24:56.631751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93c33d2f-7a5e-44c0-a7f4-1ff7072080a0',volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:24:56.957412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ad9b724d-c852-499b-a635-b9e9dbe89e98 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.918432 Oct 27 01:24:56.958600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 463/905] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:24:56 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 920 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 01:24:56.974136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:56.974862 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:56.993799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:56.994348 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:56.995126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:56.995605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:57.111490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f0bbeb96-4941-40f4-b22a-a3b2daffa8c7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.209242 Oct 27 01:24:57.112456 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 443/906] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:24:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:57.117798 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c47755a2-952a-4393-84d2-481f85fd3b05 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d361e23a0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.157413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.166751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.168470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.181762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-89b44b54-06ac-40df-b20e-297288537aec tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.213313 Oct 27 01:24:57.185353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 464/907] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:56 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:57.190709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:57.192022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:57.198969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:57.199607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:57.200550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:57.201132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:57.231541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c47755a2-952a-4393-84d2-481f85fd3b05 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 200 len: 352 microversion: 2.1 time: 0.117701 Oct 27 01:24:57.232279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 444/908] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:24:57 2021] GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:57.238079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2c30285a-496e-4489-9fb7-895d68d95479 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.238974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2c30285a-496e-4489-9fb7-895d68d95479 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:57.292373 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0ddc5e7d-b458-4f7a-84ac-ca959dd7b566 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 38178 microversion: 2.1 time: 0.105580 Oct 27 01:24:57.293009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 465/909] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:57 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 38178 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:57.309624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2c30285a-496e-4489-9fb7-895d68d95479 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.321997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2c30285a-496e-4489-9fb7-895d68d95479 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1088 microversion: 2.1 time: 0.088104 Oct 27 01:24:57.323429 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 445/910] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:57 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1088 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:58.204711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.205397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:58.212269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.212985 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.213752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.214263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.244297 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0c71c0a7-a27d-4b89-87c1-66b65c8f41fc tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d36359280>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.317132 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0c71c0a7-a27d-4b89-87c1-66b65c8f41fc tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 200 len: 353 microversion: 2.1 time: 0.075978 Oct 27 01:24:58.318744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 446/911] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:24:58 2021] GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:24:58.323840 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:58.325028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:58.331382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.331854 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.332620 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.333209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.382659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.393082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.394894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.396273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f4ef4feb-265b-4a56-9f05-add40a6941c4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.196357 Oct 27 01:24:58.407232 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 466/912] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:58 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:58.407421 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-145e5253-c0c0-4b0b-bced-9dbd4d1bc9b2 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d361ca550>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.448957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fa6b8669-700d-4821-9840-9ac8b0be60ac tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 38178 microversion: 2.1 time: 0.128353 Oct 27 01:24:58.452260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 447/913] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:58 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 38178 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:24:58.462543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-145e5253-c0c0-4b0b-bced-9dbd4d1bc9b2 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 200 len: 353 microversion: 2.1 time: 0.056590 Oct 27 01:24:58.462543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 467/914] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:24:58 2021] GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:58.464915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.465640 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:58.473523 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.474236 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.475191 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:58.475771 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:58.478688 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-18a63b6d-41b3-4cb3-96e1-c61d93653b19 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d3608d700>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.556701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.564828 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c0b276c6-cc2f-480b-846d-be4ebcde2bcf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1138 microversion: 2.1 time: 0.109788 Oct 27 01:24:58.565406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 448/915] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:58 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:58.696884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-18a63b6d-41b3-4cb3-96e1-c61d93653b19 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 202 len: 0 microversion: 2.1 time: 0.222453 Oct 27 01:24:58.697459 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 468/916] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:24:58 2021] DELETE /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:24:58.707128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-00eadf7a-607a-4b8e-8ab6-cb74b0019047 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d362e6c10>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.949288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-00eadf7a-607a-4b8e-8ab6-cb74b0019047 tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 200 len: 352 microversion: 2.1 time: 0.247066 Oct 27 01:24:58.950049 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 449/917] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:24:58 2021] GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 352 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:59.415806 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.416407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:59.422704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.423082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.423877 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.424308 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.464326 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:59.465232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:59.472477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.472923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.473695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.474163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.548591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.556358 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.557930 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.559120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d6fc6aa9-3465-4a38-8f17-222220b4072b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.147943 Oct 27 01:24:59.559676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 469/918] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:24:59 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:24:59.576716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-49895783-4421-450c-bcd4-ca01d0aa6ca6 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action" status: 200 len: 38309 microversion: 2.1 time: 0.116259 Oct 27 01:24:59.578237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 450/919] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:24:59 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/action => generated 38309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:24:59.588093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.588577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:59.588732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.589419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:24:59.595271 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.596810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.596810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.597010 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.597119 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.597237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.597973 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:24:59.598424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:24:59.620860 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fffe8403-7098-4074-90f4-defbf4465d8d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/ips" status: 200 len: 146 microversion: 2.1 time: 0.036711 Oct 27 01:24:59.625592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 470/920] 10.222.0.32 () {58 vars in 1247 bytes} [Wed Oct 27 01:24:59 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:59.671122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.681954 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-aa56036f-4531-4fb9-976b-693339b3a2cc tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1186 microversion: 2.1 time: 0.096525 Oct 27 01:24:59.682217 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 451/921] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:24:59 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:59.962108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-23688fa2-483f-4393-8107-7bfaadd3f62f tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Calling method '.version_select at 0x7f1d36370af0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.994657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-23688fa2-483f-4393-8107-7bfaadd3f62f tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] HTTP exception thrown: Volume ab1ea767-7aa8-4adf-8b30-04d42b688f8e could not be found. Oct 27 01:24:59.998304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-23688fa2-483f-4393-8107-7bfaadd3f62f tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] Returning 404 to user: Volume ab1ea767-7aa8-4adf-8b30-04d42b688f8e could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:24:59.998304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-23688fa2-483f-4393-8107-7bfaadd3f62f tempest-VolumesGetTestJSON-19864821 tempest-VolumesGetTestJSON-19864821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e" status: 404 len: 109 microversion: 2.1 time: 0.037949 Oct 27 01:24:59.998304 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 471/922] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:24:59 2021] GET /compute/v2.1/os-volumes/ab1ea767-7aa8-4adf-8b30-04d42b688f8e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:00.577026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:00.578642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:00.595877 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:00.597200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:00.597200 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:00.597589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:00.699763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:00.700507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:00.723796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:00.727317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:00.731135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:00.731739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:00.758003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.767444 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.769779 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.771383 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f144cadf-1d31-4522-865e-04ef11ce7a0b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.198589 Oct 27 01:25:00.772409 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 452/923] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:00 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:00.853649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.862838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cc372f89-e94b-4f6a-ac60-aae12a4c7fc7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1204 microversion: 2.1 time: 0.167733 Oct 27 01:25:00.864726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 472/924] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:00 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1204 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:01.390119 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1bfeb9-bca0-4adb-af81-d02b40576648"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:01.404480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:01.421472 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:01.423350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:01.424179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:01.424642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:01.798093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:01.801836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:01.822918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:01.838017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:01.845378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:01.845818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:02.080245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.093354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.110092 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.110849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-efd19d0d-900f-4f60-bd20-83c72a456da2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.322310 Oct 27 01:25:02.121680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 473/925] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:01 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:02.121680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:02.121680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:02.136222 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:02.136674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:02.137473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:02.137908 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:02.302243 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.309741 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-30a51b26-24bb-4149-8563-474ea20864a3 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1271 microversion: 2.1 time: 0.194222 Oct 27 01:25:02.310736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 474/926] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:02 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:02.592651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a4fdab25-a442-4dc8-a223-d88f683ed8d0 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.206372 Oct 27 01:25:02.593855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 453/927] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:25:01 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:02.946845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-76a492a7-1f54-4174-9eae-1b8c61a98e24 req-e8a5fee2-8cae-4590-9168-5b088bf515a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:02.948607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:02.948607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:25:02.962747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-76a492a7-1f54-4174-9eae-1b8c61a98e24 req-e8a5fee2-8cae-4590-9168-5b088bf515a3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:02.964630 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-76a492a7-1f54-4174-9eae-1b8c61a98e24 req-e8a5fee2-8cae-4590-9168-5b088bf515a3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:02.994996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-76a492a7-1f54-4174-9eae-1b8c61a98e24 req-e8a5fee2-8cae-4590-9168-5b088bf515a3 service nova] Creating event network-changed:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:25:03.002329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-76a492a7-1f54-4174-9eae-1b8c61a98e24 req-e8a5fee2-8cae-4590-9168-5b088bf515a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059218 Oct 27 01:25:03.004498 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 475/928] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:03.136597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:03.137296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:03.151906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:03.152348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:03.153146 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:03.153581 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:03.328789 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:03.329748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:03.336399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:03.337167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:03.338104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:03.338640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:03.359054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.368243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.369776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.370959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-98f25820-9613-47aa-a196-30555551d39f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.238765 Oct 27 01:25:03.371574 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 454/929] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:03 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:03.502291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.511155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6adacfd5-eb05-4582-92e9-a620c3882831 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.186591 Oct 27 01:25:03.511749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 476/930] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:03 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:04.389211 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:04.389812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:04.396591 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:04.397520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:04.398524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:04.399133 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:04.528971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:04.529843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:04.536144 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.536523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:04.536969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:04.537734 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:04.538203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:04.544055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.547071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.547071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e814d2ee-92d0-4c55-86e8-0b4bd7c6e1b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.161226 Oct 27 01:25:04.549343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 455/931] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:04 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:04.662615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.670459 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-085cf608-12d3-4afd-9359-6cdd6e76c0ac tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.145175 Oct 27 01:25:04.671210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 477/932] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:04 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:05.565280 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.565879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:05.572231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:05.572670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:05.573426 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:05.573847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:05.729865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.729865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:05.729865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:05.729865 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:05.730615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:05.730615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:05.730782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.730782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.731001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.731001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-478c6fdc-1352-4f50-ae6f-e3366a92f060 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1739 microversion: 2.20 time: 0.147911 Oct 27 01:25:05.731001 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 456/933] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:05 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:05.821324 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.829109 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d6cd88c0-9b8e-4692-a433-a2878d6a9f67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.146176 Oct 27 01:25:05.838466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 478/934] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:05 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:06.728495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.729240 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:06.735516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:06.735959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:06.736725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:06.737153 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:06.845850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.846521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:06.852897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:06.853337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:06.854126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:06.854547 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:06.861101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.869396 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.870929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.883419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6f50a732-6e31-4b1c-8abe-731969b906b0 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1721 microversion: 2.20 time: 0.158782 Oct 27 01:25:06.884002 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 457/935] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:06 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:06.995696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:07.005569 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3e5fb9be-09c4-4231-9f69-bc2ad5031570 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.163856 Oct 27 01:25:07.006745 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 479/936] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:06 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:07.902401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:07.903034 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:07.909849 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:07.910360 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:07.915140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:07.915140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:08.022505 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:08.023319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:08.032175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:08.032992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:08.037602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.039754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:08.040239 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:08.051940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.053605 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.054916 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-51d20a03-d7d3-47d4-9ba2-08da60035aaa tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1721 microversion: 2.20 time: 0.156215 Oct 27 01:25:08.057148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 458/937] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:07 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:08.168448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-1d6fa41c-5164-48f1-b90d-d850414792a3 req-79adcdfb-f5c9-43df-9d7f-e7819a09bf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "name": "network-vif-unplugged", "status": "completed", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:08.170788 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:08.170788 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:25:08.178672 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-1d6fa41c-5164-48f1-b90d-d850414792a3 req-79adcdfb-f5c9-43df-9d7f-e7819a09bf2d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:08.179216 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-1d6fa41c-5164-48f1-b90d-d850414792a3 req-79adcdfb-f5c9-43df-9d7f-e7819a09bf2d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:08.190235 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.191084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-1d6fa41c-5164-48f1-b90d-d850414792a3 req-79adcdfb-f5c9-43df-9d7f-e7819a09bf2d service nova] Creating event network-vif-unplugged:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:25:08.196998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-1d6fa41c-5164-48f1-b90d-d850414792a3 req-79adcdfb-f5c9-43df-9d7f-e7819a09bf2d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034440 Oct 27 01:25:08.198202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 459/938] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:08.200818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-22426f0b-03be-4b0a-9b43-70111d5c4272 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.180182 Oct 27 01:25:08.201412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 480/939] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:08 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:09.086861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:09.087540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:09.094327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.094863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.095808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.096355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.217675 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:09.218434 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:09.219295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.225217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.225667 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.226474 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.227163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.227445 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.228934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.230107 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2d79a5ba-6780-45d6-bbfa-cfd6f2065dc2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1664 microversion: 2.20 time: 0.147785 Oct 27 01:25:09.230885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 460/940] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:09 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:09.252788 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55732eb1-ebe5-4ecb-92ff-8af7c0290b8e"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:09.253971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:09.260551 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.261074 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.261899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:09.262424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:09.363842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.371287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-153117ed-1051-4bb3-b65f-942d6482d948 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.157312 Oct 27 01:25:09.372069 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 481/941] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:09 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:10.388406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.389065 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:10.393263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e3dd1417-1dac-4935-93b2-f0c9a428ded8 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.144993 Oct 27 01:25:10.397031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 461/942] 10.222.0.32 () {62 vars in 1363 bytes} [Wed Oct 27 01:25:09 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments => generated 188 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:25:10.397162 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:10.397494 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:10.398332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:10.398996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:10.503723 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.504204 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:10.509946 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:10.510420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:10.511169 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:10.511592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:10.526706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:10.534458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-dbdd5177-715b-42e8-945d-7bdc8a159e50 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.149837 Oct 27 01:25:10.535030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 482/943] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:10 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:11.164747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ebfb0b96-a0f5-427e-b9e0-08bea6d17d51 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments/55732eb1-ebe5-4ecb-92ff-8af7c0290b8e" status: 202 len: 0 microversion: 2.20 time: 0.665450 Oct 27 01:25:11.165384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 462/944] 10.222.0.32 () {60 vars in 1456 bytes} [Wed Oct 27 01:25:10 2021] DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments/55732eb1-ebe5-4ecb-92ff-8af7c0290b8e => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:25:11.189830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.190922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:11.196773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.197226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.198000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.198459 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.224157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:11.224714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:11.229450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f700625b-cc35-4ace-9b09-34184f3e8ca7 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Oct 27 01:25:11.230040 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 483/945] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:25:11 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:11.234165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.234165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.234165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.234165 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.239708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.240615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:11.245732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.246217 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.246975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.247402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.276879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d12e521f-565e-40df-8507-889c1e0ef57d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648" status: 200 len: 194 microversion: 2.1 time: 0.040817 Oct 27 01:25:11.282328 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 484/946] 10.222.0.32 () {58 vars in 1412 bytes} [Wed Oct 27 01:25:11 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:11.493384 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ac065a03-6939-4eab-bae8-141c2db258de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action" status: 202 len: 0 microversion: 2.20 time: 0.273021 Oct 27 01:25:11.494531 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 463/947] 10.222.0.32 () {62 vars in 1318 bytes} [Wed Oct 27 01:25:11 2021] POST /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:25:11.502637 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.503260 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:11.509370 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.509819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.510638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.511071 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.552045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.552765 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:11.560429 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.566989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.566989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:11.566989 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:11.673258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.683287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.685368 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.686784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3eb99d26-dfee-46d7-a694-27ca9fe66e19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1672 microversion: 2.20 time: 0.188400 Oct 27 01:25:11.688258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 485/948] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:11 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:11.735318 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.742603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-47c51386-6747-42df-8003-514d4a48a9d7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.194296 Oct 27 01:25:11.749947 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 464/949] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:11 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:12.707283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:12.707814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:12.714374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:12.714824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:12.715596 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:12.716035 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:12.761250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:12.761250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:12.768173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:12.768968 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:12.770148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:12.770794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:12.886255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.895952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.897893 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.915346 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eac0c5d5-a4e6-4067-af70-5d6b1c32be31 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1672 microversion: 2.20 time: 0.212687 Oct 27 01:25:12.918547 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 486/950] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:12 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:12.970995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.986281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-038f32c2-51b8-443a-82ee-aa2a2842333e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.230691 Oct 27 01:25:12.987241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 465/951] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:12 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:13.024895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88caf910-ebab-488e-b147-e75af2e71608"}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:13.032668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:13.037679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:13.039255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:13.040767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:13.041354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:13.938555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:13.939157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:13.945609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:13.946076 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:13.946932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:13.947361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:14.073780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c46bc568-dbf7-4e39-a284-23245d6a2295 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051981 Oct 27 01:25:14.075218 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 487/952] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:25:13 2021] POST /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 194 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:14.081654 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.089755 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.091301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.093399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-761d4309-4d13-47fd-8d07-c0d11d03349c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.158488 Oct 27 01:25:14.093649 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 466/953] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:13 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:14.099251 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:14.107077 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:14.118543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:14.119086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:14.120274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:14.120920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:14.268458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.276245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1f01f4fe-b581-4e69-a5a0-279f8eec9d7b tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.199654 Oct 27 01:25:14.277042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 488/954] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:14 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:14.375209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-65f0048a-2a0e-48eb-9204-c7dbfbca7650 req-df63763d-c93a-4418-a1a6-5f63eddd8244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "name": "network-vif-plugged", "status": "completed", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:14.376866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:14.376866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:25:14.383948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-65f0048a-2a0e-48eb-9204-c7dbfbca7650 req-df63763d-c93a-4418-a1a6-5f63eddd8244 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:14.384577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-65f0048a-2a0e-48eb-9204-c7dbfbca7650 req-df63763d-c93a-4418-a1a6-5f63eddd8244 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:14.397405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-65f0048a-2a0e-48eb-9204-c7dbfbca7650 req-df63763d-c93a-4418-a1a6-5f63eddd8244 service nova] Creating event network-vif-plugged:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:25:14.402147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-65f0048a-2a0e-48eb-9204-c7dbfbca7650 req-df63763d-c93a-4418-a1a6-5f63eddd8244 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030825 Oct 27 01:25:14.403156 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 467/955] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:15.112372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:15.112987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:15.119720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:15.120172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:15.120942 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:15.121375 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:15.258209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.266309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.267804 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.269112 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5709c977-9e1b-4dde-87eb-ba1c6e9af91c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.161051 Oct 27 01:25:15.269672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 489/956] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:15 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:15.293391 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:15.294102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:15.300596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:15.301033 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:15.301957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:15.302418 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:15.454004 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.463227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-755cf0e9-a9ce-4d2f-90de-c5be849b7cfb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.174294 Oct 27 01:25:15.464804 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 468/957] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:15 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:16.287628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:16.288242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:16.297695 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:16.298169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:16.298947 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:16.299602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:16.479989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.483222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:16.483222 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:16.489009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:16.489454 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:16.489814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.490559 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:16.490997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:16.491602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.492861 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5741d0b2-b15b-4287-bff5-1af16e216c6a tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.209009 Oct 27 01:25:16.493664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 490/958] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:16 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:16.668421 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.677063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4e8b7e46-b406-4f6a-902b-0b62ace0b9b0 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.199625 Oct 27 01:25:16.683892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 469/959] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:16 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:17.512122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:17.512967 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:17.523437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:17.526568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:17.527359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:17.527792 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:17.679246 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.687764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.689257 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.690440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-495c08f8-faa0-41ed-ab9b-d4fe6ce6f8de tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.182127 Oct 27 01:25:17.690996 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 491/960] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:17 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:17.706816 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:17.707751 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:17.714436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:17.714952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:17.715802 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:17.716288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:17.867698 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.875495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e36a2b88-ea49-491d-9cc2-10392859f248 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.172410 Oct 27 01:25:17.876072 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 470/961] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:17 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:18.708461 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:18.709174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:18.715983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:18.716435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:18.717202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:18.717631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:18.858044 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:18.867041 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:18.868735 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:18.870132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d90ccbed-1bce-4396-8e35-b55cda2c1593 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.165352 Oct 27 01:25:18.878784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 492/962] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:18 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:18.893121 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:18.893725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:18.900268 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:18.901204 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:18.902345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:18.903047 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:19.071791 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:19.079507 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f370fe40-a11a-4924-a286-b3ab5e3c95db tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.191072 Oct 27 01:25:19.080254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 471/963] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:18 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:19.890702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:19.891378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:19.898684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:19.899128 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:19.899903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:19.900536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:20.067625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.076363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.083029 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.084294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-95a8d461-c486-4675-bd05-ab4203fb19a4 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.197843 Oct 27 01:25:20.098656 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 493/964] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:19 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:20.103219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:20.103880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:20.111444 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:20.112458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:20.113539 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:20.114276 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:20.260902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.271501 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-652b195a-e9bb-4439-bfcd-91d20dd5bf24 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.172394 Oct 27 01:25:20.272081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 472/965] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:20 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:21.103701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:21.104309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:21.111197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:21.111636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:21.112399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:21.112830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:21.252454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.260513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.262213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.263336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-be28f767-e5ea-486b-a0ba-79f70c23f053 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.163546 Oct 27 01:25:21.263899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 494/966] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:21 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:21.289915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:21.293742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:21.299127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:21.299750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:21.300604 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:21.301148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:21.461651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.470333 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-95ed3b8c-b0b3-4c09-8004-962ef1992d1c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.184449 Oct 27 01:25:21.471508 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 473/967] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:21 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:22.281612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.282272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:22.289226 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:22.289924 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:22.290971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:22.291476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:22.431325 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.440381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.441854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.443059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-33d60112-b049-4460-b660-2a91fce3d10f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.165512 Oct 27 01:25:22.443612 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 495/968] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:22 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:22.488675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.490247 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:22.497648 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:22.498108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:22.499764 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:22.500295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:22.633590 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.643312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-293f1040-0389-4306-9cbe-738ba083ef20 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.158252 Oct 27 01:25:22.643900 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 474/969] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:22 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:23.460923 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:23.461592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:23.467362 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:23.467846 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:23.468626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:23.469049 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:23.596492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:23.604598 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:23.606125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:23.607306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-46655715-1ec5-4932-812b-d20bbfd816f2 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.150578 Oct 27 01:25:23.607852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 496/970] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:23 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:23.660471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:23.661075 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:23.671419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:23.671419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:23.671419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:23.671419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:23.816917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:23.824262 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c2f129f1-2a91-4627-a2e1-f39f977cbf67 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.167396 Oct 27 01:25:23.824886 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 475/971] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:23 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:24.626533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:24.627140 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:24.633321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:24.633768 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:24.634558 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:24.634994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:24.772260 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:24.780554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:24.782228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:24.783543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5ed1b5b3-69ef-447b-8290-62a023d102df tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.161713 Oct 27 01:25:24.784396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 497/972] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:24 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:24.841753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:24.842422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:24.848735 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:24.849169 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:24.849923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:24.850389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:24.989158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:24.996805 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3ec28198-ac6a-4d38-b3bd-0a57030ffe3e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.158653 Oct 27 01:25:24.997389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 476/973] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:24 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:25.801426 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:25.802054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:25.808212 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:25.808649 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:25.809404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:25.809828 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:25.928882 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:25.937137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:25.938682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:25.939843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-76748345-4d26-4b66-b46b-ce9e478cbc4d tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.142156 Oct 27 01:25:25.940406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 498/974] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:25 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:26.015443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:26.016179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:26.023657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:26.024096 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:26.024848 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:26.025292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:26.146776 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:26.153855 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-49ab019e-6485-46dd-84ef-e2cc919f0330 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.143371 Oct 27 01:25:26.154446 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 477/975] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:26 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:26.957911 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:26.958538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:26.964676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:26.965111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:26.965859 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:26.966321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:27.085415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.093002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.094518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.095657 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d6b1d366-5546-4441-8536-ea2338f9c95c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.141393 Oct 27 01:25:27.096203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 499/976] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:26 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:27.170197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:27.170918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:27.177151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:27.177590 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:27.178385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:27.178817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:27.297455 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.304866 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2586f0ab-3299-4521-9eda-e296bd645947 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1259 microversion: 2.1 time: 0.138315 Oct 27 01:25:27.305438 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 478/977] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:27 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:28.115973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.116736 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:28.126136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.126619 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.127592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.128203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.260236 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.268662 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.270265 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.271463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1176f2ab-532f-46f9-9d29-9c5298cd39c7 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.160560 Oct 27 01:25:28.272014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 500/978] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:28 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:28.323260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.323873 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:28.330841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.332471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.332471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.332676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.460134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.468740 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-46ec95bd-5e0a-4c5a-840c-381eeb12c2e9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1443 microversion: 2.1 time: 0.149323 Oct 27 01:25:28.469687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 479/979] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:28 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:28.492183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.492797 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:28.498634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.499106 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.499852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:28.500279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:28.622935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.631956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3e38c5d3-75db-4cd6-bfce-022e7ec3a00a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1443 microversion: 2.1 time: 0.144445 Oct 27 01:25:28.632665 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 501/980] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:28 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:29.290886 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:29.291400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:29.298081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:29.298534 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:29.299279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:29.299703 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:29.427138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:29.434830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:29.436460 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:29.437627 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4d43bc36-c5fb-441e-9b48-5296710bbeaf tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.150538 Oct 27 01:25:29.438237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 480/981] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:29 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:30.456606 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:30.557511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:30.557511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:30.557511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:30.557511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:30.559634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:30.590067 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:30.600118 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:30.602204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:30.603591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eeaaff64-d2e8-468d-8583-9cce38ef74d9 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.151415 Oct 27 01:25:30.604258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 502/982] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:30 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:31.437897 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-f35915fd-31ae-4c1a-b6a7-720f0190cca8 req-dabd4bc2-9fef-404a-bb9c-7cef35713527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:31.439393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:31.439393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:25:31.446545 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-f35915fd-31ae-4c1a-b6a7-720f0190cca8 req-dabd4bc2-9fef-404a-bb9c-7cef35713527 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:31.446963 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-f35915fd-31ae-4c1a-b6a7-720f0190cca8 req-dabd4bc2-9fef-404a-bb9c-7cef35713527 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:31.458521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-f35915fd-31ae-4c1a-b6a7-720f0190cca8 req-dabd4bc2-9fef-404a-bb9c-7cef35713527 service nova] Creating event network-changed:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:25:31.463659 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-f35915fd-31ae-4c1a-b6a7-720f0190cca8 req-dabd4bc2-9fef-404a-bb9c-7cef35713527 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029416 Oct 27 01:25:31.464266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 481/983] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:31.621854 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:31.622430 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:31.629235 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:31.629682 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:31.630504 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:31.630960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:31.757513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:31.767165 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:31.768887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:31.770181 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e0fa519c-5523-42b9-8304-b584c5d68190 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.152126 Oct 27 01:25:31.776708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 503/984] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:31 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:32.195364 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.196522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:32.204609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.205062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.206233 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.207270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.240936 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c63807e7-4704-4974-92bc-e066fd59ad4b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050779 Oct 27 01:25:32.241535 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 482/985] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:25:32 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:32.499498 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.500391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:32.506882 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.507617 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.508587 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.509242 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.546934 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d22412bf-9478-4d2b-92f3-3fef5bf4af15 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648" status: 200 len: 194 microversion: 2.1 time: 0.051751 Oct 27 01:25:32.552190 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 504/986] 10.222.0.32 () {58 vars in 1412 bytes} [Wed Oct 27 01:25:32 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:32.564768 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.569411 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:32.586407 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.586909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.587647 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.588127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.678326 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lazy-loading 'services' on Instance uuid 49ffc98f-afa7-4826-8ea3-37f8735364b4 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:25:32.788170 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.788776 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:32.795133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.796184 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.798724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:32.798724 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:32.918759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:32.926616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:32.928108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:32.929333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2a4b6f41-0d90-480a-aeaa-57ae26a1503f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.144950 Oct 27 01:25:32.929888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 505/987] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:32 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:32.975692 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cfb248cd-aa4d-4671-8088-02a1aef4b9a2 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648" status: 202 len: 0 microversion: 2.1 time: 0.419036 Oct 27 01:25:32.976541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 483/988] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:25:32 2021] DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/ce1bfeb9-bca0-4adb-af81-d02b40576648 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:25:33.947523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:33.948135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:33.954782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:33.955233 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:33.955995 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:33.956453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:34.083513 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.091480 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.093964 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.095147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ca39bf6f-3dbd-4640-8eba-272f6fa53440 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.151395 Oct 27 01:25:34.095699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 506/989] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:33 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:35.113503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:35.114227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:35.120618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:35.121062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:35.121822 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:35.122284 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:35.244630 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.253048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.254542 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.255691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d866b93b-4416-4e18-9259-36e3046d095f tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.146209 Oct 27 01:25:35.256255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 484/990] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:35 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:36.273768 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:36.274597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:36.280984 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:36.281442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:36.282326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:36.282752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:36.391876 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-bc3cae31-7e80-4ae2-a691-5e8a07f4791d req-f87f60d2-eae2-45af-84e5-536b4ebbae9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "name": "network-vif-plugged", "status": "completed", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:36.394965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:36.394965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:25:36.401762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-bc3cae31-7e80-4ae2-a691-5e8a07f4791d req-f87f60d2-eae2-45af-84e5-536b4ebbae9e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:36.402247 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-bc3cae31-7e80-4ae2-a691-5e8a07f4791d req-f87f60d2-eae2-45af-84e5-536b4ebbae9e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:36.407205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.414570 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-bc3cae31-7e80-4ae2-a691-5e8a07f4791d req-f87f60d2-eae2-45af-84e5-536b4ebbae9e service nova] Creating event network-vif-plugged:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:25:36.415163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.416644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.417788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-09cc14ae-7412-4954-b52b-98dd27f85cd3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.147740 Oct 27 01:25:36.418583 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 507/991] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:36 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:36.422174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-bc3cae31-7e80-4ae2-a691-5e8a07f4791d req-f87f60d2-eae2-45af-84e5-536b4ebbae9e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033015 Oct 27 01:25:36.422174 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 485/992] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:37.243433 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.243847 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:37.250274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.255310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.255310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.255310 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.286127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cd00b7a6-54f5-4271-9638-ac97380ce20b tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/88caf910-ebab-488e-b147-e75af2e71608" status: 200 len: 194 microversion: 2.1 time: 0.042928 Oct 27 01:25:37.286127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 508/993] 10.222.0.32 () {58 vars in 1412 bytes} [Wed Oct 27 01:25:37 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/88caf910-ebab-488e-b147-e75af2e71608 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:37.297846 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.298477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:37.304994 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.305427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.306245 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.306679 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.401094 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lazy-loading 'services' on Instance uuid 49ffc98f-afa7-4826-8ea3-37f8735364b4 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:25:37.437009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.437627 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:37.443853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.444523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.445514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:37.446171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:37.581739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:37.591575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:37.594156 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:37.595309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5cff5a1f-3ca5-4b8b-8edb-d0c811e6ee2b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.162477 Oct 27 01:25:37.595856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 509/994] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:37 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:25:37.672341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3f992a98-04c5-4ee2-b498-6301c115b49c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/88caf910-ebab-488e-b147-e75af2e71608" status: 202 len: 0 microversion: 2.1 time: 0.379107 Oct 27 01:25:37.672934 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 486/995] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:25:37 2021] DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments/88caf910-ebab-488e-b147-e75af2e71608 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:25:38.613928 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:38.614550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:38.620773 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:38.621210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:38.621954 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:38.622414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:38.753922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:38.762058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:38.763737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:38.765920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b1f62358-f4ea-45d3-a4b8-5c5ab67d8861 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1730 microversion: 2.20 time: 0.155797 Oct 27 01:25:38.766522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 510/996] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:38 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:39.785964 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:39.787838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:39.793231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:39.793679 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:39.794506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:39.794920 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:39.886711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:39.887686 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:39.894832 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:39.895275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:39.896079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:39.896510 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:39.920618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:39.925410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2ac66465-7969-43f8-b3cf-9500abeb2f09 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042495 Oct 27 01:25:39.925981 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 511/997] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:25:39 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:25:39.928910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:39.930428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:39.931706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f8b4e212-aaa6-4a17-8350-9ec7edc8490c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1717 microversion: 2.20 time: 0.151714 Oct 27 01:25:39.934061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 487/998] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:25:39 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:25:40.026315 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:40.027287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:40.034015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.034425 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.035179 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.035610 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.062926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-91c7c170-7595-4354-b333-2fb6dbab8652 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040267 Oct 27 01:25:40.063493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 512/999] 10.222.0.32 () {58 vars in 1301 bytes} [Wed Oct 27 01:25:40 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:25:40.116719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:40.117202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:40.122838 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.123351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.124248 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.124687 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.148599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:25:40.473799 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c353da98-167c-46cc-872e-9f5e44837c01 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 204 len: 0 microversion: 2.1 time: 0.360346 Oct 27 01:25:40.474423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 488/1000] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:25:40 2021] DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:25:40.482687 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:40.483288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:40.488975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.489414 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.490189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:40.490618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:40.613522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:40.618407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a30b6d63-c993-40c3-9f74-1a53516f487c tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1673 microversion: 2.1 time: 0.139345 Oct 27 01:25:40.618977 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 513/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:40 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1673 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:41.636430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:41.637196 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:41.643987 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:41.644432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:41.645194 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:41.645625 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:41.767892 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:41.775137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-884527c9-bd43-40f2-972e-f00113b90ef3 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1673 microversion: 2.1 time: 0.142791 Oct 27 01:25:41.775712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 489/1002] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:41 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1673 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:42.795033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:42.795676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:42.803114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:42.803554 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:42.804322 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:42.804750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:42.931512 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:42.939378 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-694b3155-2c40-461c-a59e-4f7895db314d tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1673 microversion: 2.1 time: 0.148033 Oct 27 01:25:42.946209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 514/1003] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:42 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:43.524348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-6da24f90-c622-494e-979f-621f99ad7406 req-c4fb8ade-458a-47f1-a33e-c8b2e56368c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffc98f-afa7-4826-8ea3-37f8735364b4", "name": "network-vif-deleted", "tag": "3643169c-0e2e-4218-80ef-98b14635f672"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:43.525935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:25:43.525935 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:25:43.536906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-6da24f90-c622-494e-979f-621f99ad7406 req-c4fb8ade-458a-47f1-a33e-c8b2e56368c2 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:43.537342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-6da24f90-c622-494e-979f-621f99ad7406 req-c4fb8ade-458a-47f1-a33e-c8b2e56368c2 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:43.549215 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-6da24f90-c622-494e-979f-621f99ad7406 req-c4fb8ade-458a-47f1-a33e-c8b2e56368c2 service nova] Creating event network-vif-deleted:3643169c-0e2e-4218-80ef-98b14635f672 for instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 on hv-cinder-81556 Oct 27 01:25:43.555787 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-6da24f90-c622-494e-979f-621f99ad7406 req-c4fb8ade-458a-47f1-a33e-c8b2e56368c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034899 Oct 27 01:25:43.556389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 490/1004] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:25:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:43.956739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:43.961190 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:43.967819 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:43.968269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:43.969034 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:43.969463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:44.012708 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:44.013338 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:44.015272 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lazy-loading 'fault' on Instance uuid 49ffc98f-afa7-4826-8ea3-37f8735364b4 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:25:44.055762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97b78644a8046da928880c62b18253d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4a231d73f5454eb53e08db96f0a471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:44.063164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-479ff91a-17aa-4c3f-9f3b-69f42d352788 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 200 len: 1327 microversion: 2.1 time: 0.110122 Oct 27 01:25:44.063733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 515/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:43 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:45.081611 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:45.082334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:45.088239 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:45.088677 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:45.089433 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:45.089863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:45.102843 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. Oct 27 01:25:45.103414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:25:45.104219 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0610522b-7bf6-4aff-82bb-21eb781a21db tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 404 len: 111 microversion: 2.1 time: 0.027864 Oct 27 01:25:45.104739 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 491/1006] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:45 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:45.112892 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-23d1e5ce-3321-4d90-89e3-9ccc3727c6ce tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '.version_select at 0x7f1d36413dc0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:45.234901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-23d1e5ce-3321-4d90-89e3-9ccc3727c6ce tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218735733" status: 202 len: 0 microversion: 2.1 time: 0.098556 Oct 27 01:25:45.234901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 516/1007] 10.222.0.32 () {58 vars in 1217 bytes} [Wed Oct 27 01:25:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218735733 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:25:48.600348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:48.601442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:48.608932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:48.609377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:48.610181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:48.610624 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:48.626978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. Oct 27 01:25:48.627567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:25:48.628458 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8d5d6ed2-c4ad-41e4-93a7-931ef4ed583a tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 404 len: 111 microversion: 2.1 time: 0.032261 Oct 27 01:25:48.629193 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 492/1008] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:25:48 2021] DELETE /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:48.638147 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:48.639237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 49ffc98f-afa7-4826-8ea3-37f8735364b4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:48.647621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:48.648399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:48.649407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:48.649895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:48.663666 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. Oct 27 01:25:48.664571 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 49ffc98f-afa7-4826-8ea3-37f8735364b4 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:25:48.665392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9e122db8-1d12-4acc-8e50-3788cbd056da tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4" status: 404 len: 111 microversion: 2.1 time: 0.031934 Oct 27 01:25:48.665939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 517/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:48 2021] GET /compute/v2.1/servers/49ffc98f-afa7-4826-8ea3-37f8735364b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:49.960714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:49.961353 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:49.969310 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:49.970296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:49.971880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:49.972201 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:49.995319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. Oct 27 01:25:49.995907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:25:50.002278 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-90e6b21e-5806-48eb-bde7-841dec9b6b4f tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 404 len: 111 microversion: 2.1 time: 0.045124 Oct 27 01:25:50.003461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 493/1010] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:25:49 2021] DELETE /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:50.013614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:50.014782 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] [instance: 99cfc0a7-3f5a-4d41-abb9-e80fc370962f] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:25:50.021445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:50.021894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:50.022704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:25:50.023127 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:25:50.042622 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] HTTP exception thrown: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. Oct 27 01:25:50.043189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] Returning 404 to user: Instance 99cfc0a7-3f5a-4d41-abb9-e80fc370962f could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:25:50.043935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a5aaa6bb-83c2-44b7-b0a1-667a86057d64 tempest-AttachVolumeTestJSON-919136226 tempest-AttachVolumeTestJSON-919136226-project] 10.222.0.32 "GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f" status: 404 len: 111 microversion: 2.1 time: 0.035464 Oct 27 01:25:50.044493 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 518/1011] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:25:50 2021] GET /compute/v2.1/servers/99cfc0a7-3f5a-4d41-abb9-e80fc370962f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:58.229642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Action: 'create', calling method: .version_select at 0x7f1d362f4670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2129270094"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:58.252428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:25:58.256927 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for user eb7fe651d1c84f28a9267a543d0e2497 and project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:25:58.907794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:25:58.912150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for user eb7fe651d1c84f28a9267a543d0e2497 and project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'key_pairs'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:25:58.930510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8efca209-282f-44d8-bcde-c4883a2ce0a6 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.917145 Oct 27 01:25:58.931553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 494/1012] 10.222.0.32 () {60 vars in 1157 bytes} [Wed Oct 27 01:25:58 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:12.983799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:12.984845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:12.991058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:12.991500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:12.992256 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:12.992684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:13.021410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b8ca0682-c397-4d73-8a23-3548801fc796 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042037 Oct 27 01:26:13.021956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 519/1013] 10.222.0.32 () {60 vars in 1342 bytes} [Wed Oct 27 01:26:12 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:13.076281 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:13.076867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:13.082714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:13.083152 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:13.083909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:13.084345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:13.108952 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:26:13.514079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7d794757-f8d9-483f-bc29-cfad9c488cde tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 204 len: 0 microversion: 2.20 time: 0.440921 Oct 27 01:26:13.514668 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 495/1014] 10.222.0.32 () {60 vars in 1279 bytes} [Wed Oct 27 01:26:13 2021] DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:26:13.522538 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:13.523135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:13.529798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:13.530279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:13.531028 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:13.531454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:13.657395 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:13.665407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:13.667237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:13.668427 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6aadf680-9c47-457a-ad36-13a275a0ed98 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.149582 Oct 27 01:26:13.669109 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 520/1015] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:26:13 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:26:14.688736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:14.691032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:14.695644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:14.696090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:14.696859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:14.697295 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:14.819373 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:14.827153 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:14.828676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:14.829826 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-518d2c3d-6f6f-4fe5-856c-6f806576edf3 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1723 microversion: 2.20 time: 0.145983 Oct 27 01:26:14.830459 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 496/1016] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:26:14 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:26:15.848263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:15.848907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:15.855479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:15.855927 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:15.856726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:15.857159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:15.918565 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:15.929338 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:15.930869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1374f1e319492da48f32b53c91f3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6304b3ad2b4e4bf398ccbae70b72f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:15.932088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-956e027a-6ce4-4173-8334-55c85db11d22 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 200 len: 1656 microversion: 2.20 time: 0.087702 Oct 27 01:26:15.932643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 521/1017] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:26:15 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:26:16.171412 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-93a49157-219b-4c99-aee9-cbd71f40ca4d req-54637bf8-35c2-48db-bba5-7ee86886a99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22168f93-be95-4a0a-ba03-afbae82e5931", "name": "network-vif-deleted", "tag": "e5a41bc8-5800-477e-a3ef-d44033785f79"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:16.173135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:26:16.173135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:26:16.180854 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-93a49157-219b-4c99-aee9-cbd71f40ca4d req-54637bf8-35c2-48db-bba5-7ee86886a99e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:16.181533 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-93a49157-219b-4c99-aee9-cbd71f40ca4d req-54637bf8-35c2-48db-bba5-7ee86886a99e service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:16.194375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-93a49157-219b-4c99-aee9-cbd71f40ca4d req-54637bf8-35c2-48db-bba5-7ee86886a99e service nova] Creating event network-vif-deleted:e5a41bc8-5800-477e-a3ef-d44033785f79 for instance 22168f93-be95-4a0a-ba03-afbae82e5931 on hv-cinder-81556 Oct 27 01:26:16.199609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-93a49157-219b-4c99-aee9-cbd71f40ca4d req-54637bf8-35c2-48db-bba5-7ee86886a99e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032275 Oct 27 01:26:16.203104 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 497/1018] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:26:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:16.951487 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:16.952291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:16.959561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:16.960130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:16.960805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:16.961228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:16.980309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. Oct 27 01:26:16.981051 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:26:16.982057 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c8c60f51-955c-4f57-8118-a4373a07ad2c tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 404 len: 111 microversion: 2.20 time: 0.035367 Oct 27 01:26:16.983611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 522/1019] 10.222.0.32 () {60 vars in 1276 bytes} [Wed Oct 27 01:26:16 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:26:16.992269 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-caf62cda-4849-41a4-bf4c-d3005293e2ba tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '.version_select at 0x7f1d36186160>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:17.066753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-caf62cda-4849-41a4-bf4c-d3005293e2ba tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771910299" status: 204 len: 0 microversion: 2.20 time: 0.078425 Oct 27 01:26:17.067362 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 498/1020] 10.222.0.32 () {60 vars in 1261 bytes} [Wed Oct 27 01:26:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771910299 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:26:19.218046 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:19.218533 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:19.225319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:19.225756 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:19.226549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:19.226983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:19.240372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. Oct 27 01:26:19.240944 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:26:19.241751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-03082554-3403-4415-a088-a42d9d7edbd1 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 404 len: 111 microversion: 2.1 time: 0.027571 Oct 27 01:26:19.242336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 523/1021] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:26:19 2021] DELETE /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:19.252266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:19.253081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: 22168f93-be95-4a0a-ba03-afbae82e5931] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:19.259005 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:19.259437 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:19.260184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:19.260610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:19.273230 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. Oct 27 01:26:19.273800 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance 22168f93-be95-4a0a-ba03-afbae82e5931 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:26:19.274642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c4138dea-15ee-4486-ba71-bd421bf3ee25 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931" status: 404 len: 111 microversion: 2.1 time: 0.028390 Oct 27 01:26:19.275163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 499/1022] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:19 2021] GET /compute/v2.1/servers/22168f93-be95-4a0a-ba03-afbae82e5931 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:26:20.719270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:20.719762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:20.727160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:20.727599 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:20.728364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:20.728793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:20.743316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. Oct 27 01:26:20.743904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:26:20.744844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a237e030-cd5a-4d6c-8fa2-61b00b77700b tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 404 len: 111 microversion: 2.1 time: 0.029822 Oct 27 01:26:20.745466 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 524/1023] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:26:20 2021] DELETE /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:20.754996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:20.755602 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] [instance: ef2a60d0-e2da-4415-8558-1da7a803e3f4] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:20.762522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:20.763112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:20.763882 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:20.764308 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:20.783995 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] HTTP exception thrown: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. Oct 27 01:26:20.788910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] Returning 404 to user: Instance ef2a60d0-e2da-4415-8558-1da7a803e3f4 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:26:20.788910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d95c8ae0-562e-450d-9ecb-cda8c5821b19 tempest-AttachVolumeShelveTestJSON-94964657 tempest-AttachVolumeShelveTestJSON-94964657-project] 10.222.0.32 "GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4" status: 404 len: 111 microversion: 2.1 time: 0.034133 Oct 27 01:26:20.788910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 500/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:20 2021] GET /compute/v2.1/servers/ef2a60d0-e2da-4415-8558-1da7a803e3f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:26:20.839733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-541901844", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2129270094", "security_groups": [{"name": "tempest-secgroup-smoke-461718875"}], "block_device_mapping_v2": [{"uuid": "cdcc4b4c-ab3d-47d9-acab-69709422805a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6e401b1-a90b-4326-8b49-61e14b7b154a"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:20.955744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] validate_networks() for [('d6e401b1-a90b-4326-8b49-61e14b7b154a', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:26:21.509022 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:26:21.509477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:26:21.509949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:26:21.510432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:26:21.510841 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:26:21.520483 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:21.520869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:21.521715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:21.522180 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:21.542935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:26:21.548314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for user eb7fe651d1c84f28a9267a543d0e2497 and project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:26:21.607506 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:26:21.609811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdcc4b4c-ab3d-47d9-acab-69709422805a',volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:26:22.122998 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5be7cf8c-8344-43d5-894c-e7d720986346 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.287900 Oct 27 01:26:22.124021 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 525/1025] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:26:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:26:22.139425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6fd1aadb-548b-407a-9985-546a1c7784c2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:22.139425 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6fd1aadb-548b-407a-9985-546a1c7784c2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:22.204911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6fd1aadb-548b-407a-9985-546a1c7784c2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:22.211817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6fd1aadb-548b-407a-9985-546a1c7784c2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1094 microversion: 2.1 time: 0.081567 Oct 27 01:26:22.212380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 501/1026] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:22 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:23.229739 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-06271f87-684c-436b-ae3d-b60e583fc581 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:23.231230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-06271f87-684c-436b-ae3d-b60e583fc581 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:23.486225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-06271f87-684c-436b-ae3d-b60e583fc581 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:23.492897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-06271f87-684c-436b-ae3d-b60e583fc581 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1094 microversion: 2.1 time: 0.267964 Oct 27 01:26:23.502224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 526/1027] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:23 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1094 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:24.516309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:24.517438 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:24.532053 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:24.533338 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:24.534402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:24.534996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:24.620250 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:24.629443 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ff558316-ac71-498f-b377-47b9ad2ec19b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1192 microversion: 2.1 time: 0.122280 Oct 27 01:26:24.634492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 502/1028] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:24 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:25.648581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:25.649822 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:25.657454 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:25.657903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:25.658725 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:25.659216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:25.723035 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:25.731694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3d4779d0-c7fb-4b07-80c8-f8c0c2665a28 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1210 microversion: 2.1 time: 0.086431 Oct 27 01:26:25.732786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 527/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:25 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:26.753501 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:26.754944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:26.771477 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:26.772038 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:26.773945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:26.776354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:26.915190 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:26.923105 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a6cdb53a-3d06-404d-9463-e4f3a9456b65 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1277 microversion: 2.1 time: 0.178082 Oct 27 01:26:26.923682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 503/1030] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:26 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:26.955440 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-42ade2e5-c53c-4d76-b2d7-cb33313138d2 req-d556bf1e-bd71-48fb-8f5e-b6fd538525f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a39a6a3-72c4-4c0d-8bad-2971fbebc302", "tag": "b47b9ded-707a-4e56-a5c7-2e7f5cee57d1"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:26.959231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:26:26.959231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:26:26.969031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-42ade2e5-c53c-4d76-b2d7-cb33313138d2 req-d556bf1e-bd71-48fb-8f5e-b6fd538525f5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:26.970209 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-42ade2e5-c53c-4d76-b2d7-cb33313138d2 req-d556bf1e-bd71-48fb-8f5e-b6fd538525f5 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:26.983845 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-42ade2e5-c53c-4d76-b2d7-cb33313138d2 req-d556bf1e-bd71-48fb-8f5e-b6fd538525f5 service nova] Creating event network-changed:b47b9ded-707a-4e56-a5c7-2e7f5cee57d1 for instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 on hv-cinder-81556 Oct 27 01:26:26.989759 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-42ade2e5-c53c-4d76-b2d7-cb33313138d2 req-d556bf1e-bd71-48fb-8f5e-b6fd538525f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038814 Oct 27 01:26:26.990494 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 528/1031] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:26:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:27.940420 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:27.941052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:27.947178 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:27.947615 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:27.948367 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:27.948789 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:28.075234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:28.083158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-987d9b78-2f7c-49fd-8466-2bac0ff17a6a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.146333 Oct 27 01:26:28.083730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 504/1032] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:27 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:29.102003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:29.102714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:29.108660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:29.109100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:29.109855 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:29.110318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:29.237160 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:29.244517 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c8491df7-f019-4a5c-8a62-d1d017e6576a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.147299 Oct 27 01:26:29.245076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 529/1033] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:29 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:29.892488 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e15f5310-a18c-4fc5-b056-1c9be9b63f62 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d3628c160>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:29.937623 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e15f5310-a18c-4fc5-b056-1c9be9b63f62 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/2e8aa219-45e6-49c3-8a91-caac25bc6b1e" status: 200 len: 351 microversion: 2.1 time: 0.048781 Oct 27 01:26:29.938214 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 505/1034] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:26:29 2021] GET /compute/v2.1/os-volumes/2e8aa219-45e6-49c3-8a91-caac25bc6b1e => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:30.260864 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:30.261467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:30.267652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:30.268093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:30.268850 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:30.269279 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:30.389191 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:30.396653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-00b59494-5f4c-4ac8-9a68-146e2bd85fd3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.139422 Oct 27 01:26:30.401731 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 530/1035] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:30 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:31.413607 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:31.414266 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:31.421058 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:31.421502 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:31.422292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:31.422817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:31.544569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:31.553227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3dd49811-a608-49ae-995f-fccbe45ef9f0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.142707 Oct 27 01:26:31.553227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 506/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:31 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:31.603126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3517c3d9-7345-494e-af0a-4954fb3e5a13 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d36cf99d0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:31.649552 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3517c3d9-7345-494e-af0a-4954fb3e5a13 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c9e4243e-9489-4f53-b1bc-f00a2e25396e" status: 200 len: 350 microversion: 2.1 time: 0.050147 Oct 27 01:26:31.650231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 531/1037] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:26:31 2021] GET /compute/v2.1/os-volumes/c9e4243e-9489-4f53-b1bc-f00a2e25396e => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:32.568461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:32.569068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:32.575382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:32.575824 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:32.576582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:32.577013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:32.700388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:32.708012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7818da08-7c67-4885-b419-49d669d5d8d4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.143148 Oct 27 01:26:32.708590 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 507/1038] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:32 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:33.352722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-25891d48-466e-40ce-8661-a0f88bce17d8 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d364135e0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.402053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-25891d48-466e-40ce-8661-a0f88bce17d8 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ab7dfc72-4d76-4f46-a938-08384b5da78f" status: 200 len: 351 microversion: 2.1 time: 0.050064 Oct 27 01:26:33.402053 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 532/1039] 10.222.0.32 () {58 vars in 1244 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes/ab7dfc72-4d76-4f46-a938-08384b5da78f => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:33.412898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4b2a0705-a8eb-40d9-b76c-921e2f46d926 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d361ed9d0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.491137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4b2a0705-a8eb-40d9-b76c-921e2f46d926 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081733 Oct 27 01:26:33.491698 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 508/1040] 10.222.0.32 () {58 vars in 1133 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:33.503446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-9afe1d43-bf4c-4357-94c5-cc4ec22312a7 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d3612ee50>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.584068 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-9afe1d43-bf4c-4357-94c5-cc4ec22312a7 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084072 Oct 27 01:26:33.584640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 533/1041] 10.222.0.32 () {58 vars in 1148 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:33.596644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-61b166f9-5736-4664-8efc-9dba68fdf1f5 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d361763a0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.675012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-61b166f9-5736-4664-8efc-9dba68fdf1f5 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082437 Oct 27 01:26:33.675658 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 509/1042] 10.222.0.32 () {58 vars in 1133 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:33.687288 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e5e91c69-3e18-4210-9755-f9210ec1cf45 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d36413ca0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.724773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.725380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:33.731170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:33.731612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:33.732376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:33.732808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:33.767989 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e5e91c69-3e18-4210-9755-f9210ec1cf45 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084996 Oct 27 01:26:33.768652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 534/1043] 10.222.0.32 () {58 vars in 1166 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:33.780375 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bb6bcef1-74a8-4e71-852b-d5f9164042a1 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d36cf9280>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.857290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:33.860983 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bb6bcef1-74a8-4e71-852b-d5f9164042a1 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084616 Oct 27 01:26:33.861558 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 535/1044] 10.222.0.32 () {58 vars in 1169 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:26:33.864720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-03961e93-f357-4121-b45c-5382b07a5702 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.143817 Oct 27 01:26:33.865278 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 510/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:33.872976 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-09caa937-9dad-424f-93be-e54cd5444085 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d38a479d0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.950347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-09caa937-9dad-424f-93be-e54cd5444085 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080054 Oct 27 01:26:33.950922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 536/1046] 10.222.0.32 () {58 vars in 1154 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:33.961812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2d473ba0-b067-486a-b1ce-8d279e0f3bc4 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d36200ee0>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:34.041782 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2d473ba0-b067-486a-b1ce-8d279e0f3bc4 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083434 Oct 27 01:26:34.042451 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 511/1047] 10.222.0.32 () {58 vars in 1187 bytes} [Wed Oct 27 01:26:33 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:34.054253 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fc20e851-9d54-4844-a363-ea7bf82c8775 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] Calling method '.version_select at 0x7f1d36e22670>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:34.131314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fc20e851-9d54-4844-a363-ea7bf82c8775 tempest-VolumesTestJSON-831839589 tempest-VolumesTestJSON-831839589-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080572 Oct 27 01:26:34.131940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 537/1048] 10.222.0.32 () {58 vars in 1154 bytes} [Wed Oct 27 01:26:34 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:34.882320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:34.882875 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:34.889339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:34.889811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:34.890608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:34.891035 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:35.023279 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:35.031367 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2a0833d6-4a3f-4329-bd0f-37c1c5c4d84d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.153272 Oct 27 01:26:35.032028 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 512/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:34 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:36.048511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:36.049442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:36.055319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:36.055762 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:36.056521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:36.056951 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:36.180509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:36.188969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e19400c8-3c61-4854-b7b1-ea04a0407b20 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.144559 Oct 27 01:26:36.189530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 538/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:36 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:37.137975 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-ab106a9e-fa31-40a3-b57a-3e18b6d6c017 req-21f96dd6-de71-4897-85d1-580b0e55aab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a39a6a3-72c4-4c0d-8bad-2971fbebc302", "name": "network-vif-plugged", "status": "completed", "tag": "b47b9ded-707a-4e56-a5c7-2e7f5cee57d1"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:37.139653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:26:37.139653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:26:37.146786 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-ab106a9e-fa31-40a3-b57a-3e18b6d6c017 req-21f96dd6-de71-4897-85d1-580b0e55aab3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:37.147224 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-ab106a9e-fa31-40a3-b57a-3e18b6d6c017 req-21f96dd6-de71-4897-85d1-580b0e55aab3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:37.157839 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-ab106a9e-fa31-40a3-b57a-3e18b6d6c017 req-21f96dd6-de71-4897-85d1-580b0e55aab3 service nova] Creating event network-vif-plugged:b47b9ded-707a-4e56-a5c7-2e7f5cee57d1 for instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 on hv-cinder-81556 Oct 27 01:26:37.163532 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-ab106a9e-fa31-40a3-b57a-3e18b6d6c017 req-21f96dd6-de71-4897-85d1-580b0e55aab3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 Oct 27 01:26:37.165132 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 513/1051] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:26:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:37.206751 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:37.207258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:37.213903 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:37.214511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:37.215467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:37.216031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:37.358993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:37.366326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-71d07d45-5d03-4769-9c28-da69bdc915e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.163870 Oct 27 01:26:37.366902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 539/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:37 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:38.383645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:38.384598 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:38.391718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:38.392150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:38.392956 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:38.393377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:38.517681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:38.525221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d3a3c7a5-96f8-45f3-a425-5d2144cbf935 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1265 microversion: 2.1 time: 0.145478 Oct 27 01:26:38.525793 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 514/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:38 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:39.547227 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:39.548063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:39.554185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:39.554623 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:39.555388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:39.555815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:39.683087 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:39.690958 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-6861baa1-7fbd-4a90-b489-b25dbf45ee5c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1451 microversion: 2.1 time: 0.147339 Oct 27 01:26:39.691654 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 540/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:39 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:39.707794 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:39.708500 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:39.714897 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:39.715339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:39.716097 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:39.716526 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:39.844926 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:39.852867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1965940b-be44-4230-ad83-9f1ad2cd7b9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1451 microversion: 2.1 time: 0.148705 Oct 27 01:26:39.853560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 515/1055] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:39 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:42.161847 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-5469379a-9917-4d3a-99dd-67fced582381 req-1043d099-249d-459d-86fd-79edbea2b71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a39a6a3-72c4-4c0d-8bad-2971fbebc302", "tag": "b47b9ded-707a-4e56-a5c7-2e7f5cee57d1"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:42.163415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:26:42.163415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:26:42.176298 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5469379a-9917-4d3a-99dd-67fced582381 req-1043d099-249d-459d-86fd-79edbea2b71d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:42.176469 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5469379a-9917-4d3a-99dd-67fced582381 req-1043d099-249d-459d-86fd-79edbea2b71d service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:42.188326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-5469379a-9917-4d3a-99dd-67fced582381 req-1043d099-249d-459d-86fd-79edbea2b71d service nova] Creating event network-changed:b47b9ded-707a-4e56-a5c7-2e7f5cee57d1 for instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 on hv-cinder-81556 Oct 27 01:26:42.196827 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-5469379a-9917-4d3a-99dd-67fced582381 req-1043d099-249d-459d-86fd-79edbea2b71d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166835 Oct 27 01:26:42.197953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 541/1056] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:52.136588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1799016599", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "db7a7956-5753-48f1-84a3-719e54952fae"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:52.189658 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] validate_networks() for [('db7a7956-5753-48f1-84a3-719e54952fae', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:26:52.524472 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:26:52.524885 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:26:52.525351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:26:52.525750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:26:52.526205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:26:52.535056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:52.535495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:52.536282 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:52.536707 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:52.553712 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Getting quotas for project 0201f20f8a2e46e6a8ceb7bccf7659df. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:26:52.557406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Getting quotas for user a6fb31f457cb4c268d6f4e06bf5ee703 and project 0201f20f8a2e46e6a8ceb7bccf7659df. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:26:52.568070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:26:52.570334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:26:52.708056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-235f317b-d9ba-42e0-979b-83da487d0c64 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575513 Oct 27 01:26:52.708700 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 516/1057] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:26:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:26:52.720313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-76e5e233-2a55-4625-8b2b-fc5fd71147d0 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:52.721205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-76e5e233-2a55-4625-8b2b-fc5fd71147d0 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:52.779228 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-76e5e233-2a55-4625-8b2b-fc5fd71147d0 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:52.785830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-76e5e233-2a55-4625-8b2b-fc5fd71147d0 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1219 microversion: 2.1 time: 0.069894 Oct 27 01:26:52.786492 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 542/1058] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:52 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:53.802653 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:53.803263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:53.809190 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:53.809705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:53.810513 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:53.810944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:53.874194 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:53.881389 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3dc19749-6b82-41f9-a783-4cab548dbbc2 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1223 microversion: 2.1 time: 0.082963 Oct 27 01:26:53.881962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 517/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:53 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:54.898204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:54.898813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:54.905656 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:54.906142 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:54.906896 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:54.907329 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:54.965939 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:54.973097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d23ea53c-fc68-4277-b6ca-95769d9d38c6 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1271 microversion: 2.1 time: 0.078526 Oct 27 01:26:54.973656 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 543/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:54 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:55.990520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:55.991131 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:55.998009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:55.998487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:55.999320 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:55.999757 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:56.124368 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:56.133675 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b977028a-b817-4c37-bbe8-cdb9966c63fe tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.146831 Oct 27 01:26:56.134460 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 518/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:55 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:56.807668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-54959434-d500-4177-a485-c109a9886410 req-da3f0d28-710b-466b-a419-7b8d70524b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359ae674-d03a-4657-a1f6-6bcd0078dca9", "tag": "7de1aad2-7e54-46f1-b67e-42a166518942"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:56.809442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:26:56.809442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:26:56.817038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-54959434-d500-4177-a485-c109a9886410 req-da3f0d28-710b-466b-a419-7b8d70524b56 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:56.817614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-54959434-d500-4177-a485-c109a9886410 req-da3f0d28-710b-466b-a419-7b8d70524b56 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:56.830562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-54959434-d500-4177-a485-c109a9886410 req-da3f0d28-710b-466b-a419-7b8d70524b56 service nova] Creating event network-changed:7de1aad2-7e54-46f1-b67e-42a166518942 for instance 359ae674-d03a-4657-a1f6-6bcd0078dca9 on hv-cinder-81556 Oct 27 01:26:56.835509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-54959434-d500-4177-a485-c109a9886410 req-da3f0d28-710b-466b-a419-7b8d70524b56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032332 Oct 27 01:26:56.836283 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 544/1062] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:57.151402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:57.152708 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:57.159167 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:57.159634 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:57.160388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:57.160817 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:57.282128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:57.289377 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dcd865d5-1b66-42df-87f2-2ed580fa929e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.141815 Oct 27 01:26:57.289939 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 519/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:57 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:58.307139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:58.308383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:58.315354 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:58.315795 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:58.316561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:58.317083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:58.470273 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:58.477620 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ee97da26-d85f-4cca-9bfd-0a13be0789e7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.174676 Oct 27 01:26:58.478214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 545/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:58 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:59.493872 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:59.494527 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:26:59.500888 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:59.501366 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:59.502095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:26:59.502521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:26:59.624888 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:59.632060 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b4dda2ff-6e25-490d-b049-1fba30adcf75 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.141990 Oct 27 01:26:59.632622 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 520/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:26:59 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:00.649365 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:00.650081 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:00.657122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:00.657573 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:00.660910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:00.660910 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:00.783660 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:00.791241 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-94bafcdd-a401-4315-a406-a713c7e68944 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.145735 Oct 27 01:27:00.791811 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 546/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:00 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:01.265558 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-9667b86e-1a07-4bc2-986e-e8d8f1d99e7a req-f074bb59-8714-441d-a087-5647940882c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359ae674-d03a-4657-a1f6-6bcd0078dca9", "name": "network-vif-plugged", "status": "completed", "tag": "7de1aad2-7e54-46f1-b67e-42a166518942"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:01.267150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:01.267150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:27:01.274337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-9667b86e-1a07-4bc2-986e-e8d8f1d99e7a req-f074bb59-8714-441d-a087-5647940882c1 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:01.274778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-9667b86e-1a07-4bc2-986e-e8d8f1d99e7a req-f074bb59-8714-441d-a087-5647940882c1 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:01.285773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-9667b86e-1a07-4bc2-986e-e8d8f1d99e7a req-f074bb59-8714-441d-a087-5647940882c1 service nova] Creating event network-vif-plugged:7de1aad2-7e54-46f1-b67e-42a166518942 for instance 359ae674-d03a-4657-a1f6-6bcd0078dca9 on hv-cinder-81556 Oct 27 01:27:01.290655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-9667b86e-1a07-4bc2-986e-e8d8f1d99e7a req-f074bb59-8714-441d-a087-5647940882c1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029593 Oct 27 01:27:01.291452 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 521/1067] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:01.809254 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:01.809991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:01.816316 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:01.816787 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:01.817550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:01.817975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:01.945072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:01.952306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eda27fe9-8f33-4d63-97c0-e6d91a556b11 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.147559 Oct 27 01:27:01.956415 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 547/1068] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:01 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:02.969632 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:02.970348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:02.976670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:02.977110 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:02.977864 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:02.978325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:03.101415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:03.108684 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b19d8707-faa3-4522-8feb-f66b01f2d974 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.143519 Oct 27 01:27:03.109232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 522/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:02 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:04.126064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:04.126588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:04.132702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:04.133139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:04.133887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:04.134342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:04.254539 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:04.262357 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-36f7c8a5-dabc-48f4-9f64-2189e6ad81fd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.140029 Oct 27 01:27:04.262922 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 548/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:04 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:05.278489 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:05.279078 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:05.285229 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:05.285667 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:05.286457 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:05.286881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:05.412221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:05.419940 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-9581d705-2067-48ef-b10a-c4ab1c976b4c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1319 microversion: 2.1 time: 0.145024 Oct 27 01:27:05.420506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 523/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:05 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:06.436473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:06.437101 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:06.443309 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:06.443752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:06.444550 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:06.444972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:06.567971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:06.575788 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-551f1f58-d4d7-4537-a42d-96f5b84515bd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1508 microversion: 2.1 time: 0.143064 Oct 27 01:27:06.576345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 549/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:06 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:16.382918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:16.383564 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:16.389674 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:16.390114 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:16.390884 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:16.391317 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:16.414421 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lazy-loading 'flavor' on Instance uuid b59a1076-7156-48a7-8e09-75b55aac1a27 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:27:16.896419 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-336eee93-6828-4542-947b-01d6d9705f95 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "POST /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27/action" status: 202 len: 0 microversion: 2.1 time: 0.518156 Oct 27 01:27:16.897046 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 524/1073] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:27:16 2021] POST /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:27:16.905711 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:16.906353 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:16.913158 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:16.913590 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:16.914558 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:16.914987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:17.048581 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:17.055791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c1f0091a-fe20-4135-92af-89bc160df89e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.153701 Oct 27 01:27:17.056344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 550/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:16 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:17.400017 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-685777650", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "baadc2e5-ef47-411c-b34f-076291332e36"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:17.452546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] validate_networks() for [('baadc2e5-ef47-411c-b34f-076291332e36', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:27:17.796015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:27:17.796431 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:27:17.796898 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:27:17.797298 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:27:17.797701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:27:17.806122 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:17.806562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:17.807843 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:17.808274 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:17.825294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Getting quotas for project ca625749d153471ea9f389ce0cb40803. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:27:17.829519 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Getting quotas for user 1df7faf4f8de4ae3b22a0b393dd970df and project ca625749d153471ea9f389ce0cb40803. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:27:17.843108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:27:17.845727 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:27:18.027709 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-514a7e72-96a4-4b73-956a-82968208242c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632290 Oct 27 01:27:18.028342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 525/1075] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:27:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:27:18.037813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-64390b05-da4a-4873-b044-6b16e9b39bdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:18.038441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-64390b05-da4a-4873-b044-6b16e9b39bdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:18.072830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:18.073861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:18.080423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:18.081030 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:18.081897 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:18.082439 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:18.090515 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-64390b05-da4a-4873-b044-6b16e9b39bdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:18.097183 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-64390b05-da4a-4873-b044-6b16e9b39bdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1213 microversion: 2.1 time: 0.062918 Oct 27 01:27:18.097753 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 551/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:18 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:18.219842 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:18.228213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ff7ad116-71f1-4f80-bf20-32eb3f9e67c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.159349 Oct 27 01:27:18.228788 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 526/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:18 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:19.115424 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-df12ce42-8d44-4a38-97fa-df375824e1b7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:19.115942 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-df12ce42-8d44-4a38-97fa-df375824e1b7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:19.171013 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-df12ce42-8d44-4a38-97fa-df375824e1b7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:19.177701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-df12ce42-8d44-4a38-97fa-df375824e1b7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1213 microversion: 2.1 time: 0.065924 Oct 27 01:27:19.178311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 552/1078] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:19 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:19.245484 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:19.246166 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:19.252999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:19.253444 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:19.254234 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:19.254666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:19.377014 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:19.384218 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-89d3bd8d-a15b-4484-a009-5996e76765df tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.143238 Oct 27 01:27:19.388836 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 527/1079] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:19 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:20.195778 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:20.196452 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:20.203343 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:20.206593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:20.206593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:20.206593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:20.268076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:20.275800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b0f79d1c-086a-492c-8c20-9e03b64b623c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1265 microversion: 2.1 time: 0.083740 Oct 27 01:27:20.276359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 553/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:20 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:20.401422 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:20.402050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:20.408328 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:20.408773 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:20.409670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:20.410146 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:20.536406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:20.545315 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-370ee043-bb1b-4ffb-b9a3-fc60949f1d19 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.147734 Oct 27 01:27:20.545881 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 528/1081] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:20 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:21.296312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:21.296897 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:21.303207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:21.304269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:21.305034 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:21.305460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:21.369159 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:21.377215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ec4ba861-28df-4880-aa66-3d1b4c9f719f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1271 microversion: 2.1 time: 0.084781 Oct 27 01:27:21.377780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 554/1082] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:21 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:21.567603 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:21.568206 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:21.574585 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:21.575100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:21.575850 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:21.576283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:21.700706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:21.708016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1bb9f8df-181a-4af9-92e9-2681f368230a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.144123 Oct 27 01:27:21.708594 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 529/1083] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:21 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:22.394422 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:22.401061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:22.401956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:22.402453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:22.403219 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:22.403644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:22.523211 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:22.530869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5c1fe67b-9aaa-42d7-9eef-55391a8011f1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.140145 Oct 27 01:27:22.532299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 555/1084] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:22 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:22.725853 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:22.726486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:22.734045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:22.734413 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:22.735184 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:22.735608 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:22.770122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-ab663960-16b8-4387-a804-511998c4af63 req-4d73bd57-938a-44ba-8859-3932636e3b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6149ea3b-b9fc-4e84-ba35-260a1169c3cc", "tag": "943434cc-fcd8-41b9-9052-099dfa003944"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:22.771719 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:22.771719 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:27:22.785135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ab663960-16b8-4387-a804-511998c4af63 req-4d73bd57-938a-44ba-8859-3932636e3b8a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:22.786084 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ab663960-16b8-4387-a804-511998c4af63 req-4d73bd57-938a-44ba-8859-3932636e3b8a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:22.801126 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-ab663960-16b8-4387-a804-511998c4af63 req-4d73bd57-938a-44ba-8859-3932636e3b8a service nova] Creating event network-changed:943434cc-fcd8-41b9-9052-099dfa003944 for instance 6149ea3b-b9fc-4e84-ba35-260a1169c3cc on hv-cinder-81556 Oct 27 01:27:22.806080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-ab663960-16b8-4387-a804-511998c4af63 req-4d73bd57-938a-44ba-8859-3932636e3b8a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039691 Oct 27 01:27:22.806699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 556/1085] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:22.865588 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:22.874157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4e73d0d9-7f1e-4e2e-9c27-dfa9b129c6eb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.152056 Oct 27 01:27:22.875141 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 530/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:22 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:23.548619 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:23.549465 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:23.555522 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:23.555963 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:23.556716 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:23.557225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:23.679640 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:23.686913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-aeb7976b-c421-4bd4-8bd6-f823aa714627 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.142917 Oct 27 01:27:23.687481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 557/1087] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:23 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:23.891691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:23.892285 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:23.898480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:23.902586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:23.902586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:23.902586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:24.019106 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:24.030015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-816c61e4-2b3b-4bc1-ad77-f689fba36731 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.140090 Oct 27 01:27:24.030015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 531/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:23 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:24.704396 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:24.704995 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:24.711252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:24.711696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:24.712445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:24.712871 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:24.833573 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:24.840945 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0c54aa0f-9c93-47d1-8e17-15b6261e72fe tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.140169 Oct 27 01:27:24.841503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 558/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:24 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:25.045071 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:25.045871 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:25.051978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:25.052607 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:25.053379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:25.053811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:25.172775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:25.180247 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-74d11627-7b74-4449-a757-ee191d441754 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.139530 Oct 27 01:27:25.180832 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 532/1090] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:25 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:25.857743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:25.858375 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:25.865332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:25.865771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:25.866563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:25.866988 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:25.987214 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:25.995363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cad99784-8e12-4599-8398-e8d858e54061 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.140701 Oct 27 01:27:25.995948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 559/1091] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:25 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:26.200796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:26.201430 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:26.207715 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:26.208183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:26.208969 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:26.209400 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:26.333195 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:26.341774 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-72a8979b-6618-40d6-acd0-9d4aa571d275 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.144710 Oct 27 01:27:26.349673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 533/1092] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:26 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:27.012189 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:27.012789 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:27.019086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.019530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.020276 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.020703 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.139567 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:27.146648 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3fc61605-7121-4f60-8fff-dd336ae34cdf tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.138346 Oct 27 01:27:27.147215 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 560/1093] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:27 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:27.225612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e2e66d9-4331-42e5-a022-16cdbaa47b3e", "device": "/dev/sdb"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:27.227270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:27.233560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.234009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.234810 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.235248 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.359689 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:27.360361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:27.366532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.367063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.367856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:27.368294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:27.503670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:27.511836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ee2194bd-4284-4fa3-b96c-b88f5dac964f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.155945 Oct 27 01:27:27.512413 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 561/1094] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:27 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:28.061969 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0bde436e-0825-4d9d-ae0a-4e27c53947ba tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "POST /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840215 Oct 27 01:27:28.062546 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 534/1095] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:27:27 2021] POST /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:28.163775 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:28.164394 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:28.171360 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:28.171803 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:28.172563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:28.172990 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:28.297960 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:28.304139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ed62ef75-4545-4718-b982-c9f8bb5430b1 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.144043 Oct 27 01:27:28.304694 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 562/1096] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:28 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:28.530211 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:28.530915 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:28.536852 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:28.537288 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:28.538056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:28.538484 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:28.659088 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:28.666448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f8119088-ce19-4523-aeac-00424335126c tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.141176 Oct 27 01:27:28.667014 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 535/1097] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:28 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:29.320435 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:29.321066 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:29.328412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:29.328863 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:29.329672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:29.330136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:29.467080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:29.467213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-2ff5b19d-e157-4500-b425-3d9cf3e88220 req-941a5e1f-8979-422f-bfe5-863b07cb42ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6149ea3b-b9fc-4e84-ba35-260a1169c3cc", "name": "network-vif-plugged", "status": "completed", "tag": "943434cc-fcd8-41b9-9052-099dfa003944"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:29.467213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:29.467213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:27:29.467497 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-057cf82d-cf13-4781-81b5-d37f3e224040 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.145052 Oct 27 01:27:29.467589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2ff5b19d-e157-4500-b425-3d9cf3e88220 req-941a5e1f-8979-422f-bfe5-863b07cb42ec service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:29.467589 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2ff5b19d-e157-4500-b425-3d9cf3e88220 req-941a5e1f-8979-422f-bfe5-863b07cb42ec service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:29.467838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 563/1098] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:29 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:29.475613 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-2ff5b19d-e157-4500-b425-3d9cf3e88220 req-941a5e1f-8979-422f-bfe5-863b07cb42ec service nova] Creating event network-vif-plugged:943434cc-fcd8-41b9-9052-099dfa003944 for instance 6149ea3b-b9fc-4e84-ba35-260a1169c3cc on hv-cinder-81556 Oct 27 01:27:29.481296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-2ff5b19d-e157-4500-b425-3d9cf3e88220 req-941a5e1f-8979-422f-bfe5-863b07cb42ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029099 Oct 27 01:27:29.482329 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 536/1099] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:29.683043 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:29.683723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:29.689481 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:29.689928 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:29.690728 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:29.691158 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:29.813766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:29.821130 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-23fccee8-04d5-4fa0-a333-0c855cbc8627 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.141943 Oct 27 01:27:29.821690 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 564/1100] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:29 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:30.480358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:30.480972 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:30.487358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:30.487797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:30.488550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:30.488974 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:30.612038 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:30.619917 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-70363255-69c2-4f61-b1a3-c5dac7aecdae tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1313 microversion: 2.1 time: 0.143537 Oct 27 01:27:30.620697 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 537/1101] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:30 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:30.837511 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:30.838737 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:30.844999 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:30.846078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:30.846193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:30.846618 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:30.966948 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:30.974633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4a767762-30cd-4561-aeec-444574f399fa tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.140721 Oct 27 01:27:30.975201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 565/1102] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:30 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:31.637221 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:31.637750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:31.643966 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:31.644406 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:31.645157 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:31.645586 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:31.769428 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:31.776955 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b66412c4-ff31-4b8c-90a0-4a303aeae76a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1496 microversion: 2.1 time: 0.144120 Oct 27 01:27:31.777517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 538/1103] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:31 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1496 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:31.992079 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:31.992638 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:31.999920 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.003562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.003562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.003562 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.123873 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:32.131274 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-3a93d3a5-c96d-4b05-8b29-df061d3b57d2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1508 microversion: 2.1 time: 0.143043 Oct 27 01:27:32.131895 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 566/1104] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:31 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:32.147743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:32.148369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:32.154593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.155031 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.155781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.156205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.377070 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-7de8b64c-5732-4864-be57-93bfcd30ecb1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "POST /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27/action" status: 202 len: 0 microversion: 2.1 time: 0.232887 Oct 27 01:27:32.377785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 539/1105] 10.222.0.32 () {60 vars in 1277 bytes} [Wed Oct 27 01:27:32 2021] POST /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:27:32.393393 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:32.394133 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:32.400593 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.401164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.402002 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.402472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.523914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:32.531645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-73ce46b9-859d-4286-93d5-c3b37a47a4d8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1516 microversion: 2.1 time: 0.142187 Oct 27 01:27:32.532455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 567/1106] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:32 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1516 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:32.801865 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:32.802398 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:32.808202 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.808641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.809393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:32.809820 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:32.833436 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:27:33.177491 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-52d24c0d-7237-4029-8569-600dedaf2544 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 204 len: 0 microversion: 2.1 time: 0.379503 Oct 27 01:27:33.178144 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 540/1107] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:27:32 2021] DELETE /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:27:33.186453 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:33.187059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:33.193231 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:33.193672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:33.194459 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:33.194886 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:33.321442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:33.329388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fbefac17-5084-45c6-9f59-d684322861fd tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1502 microversion: 2.1 time: 0.146506 Oct 27 01:27:33.329957 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 568/1108] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:33 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:33.354728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-dd58364b-4e7e-4e88-b862-48cdde683015 req-219b928e-029c-4f26-b538-55903ea98622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "name": "network-vif-unplugged", "status": "completed", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:33.356274 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:33.356274 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:27:33.363223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-dd58364b-4e7e-4e88-b862-48cdde683015 req-219b928e-029c-4f26-b538-55903ea98622 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:33.363676 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-dd58364b-4e7e-4e88-b862-48cdde683015 req-219b928e-029c-4f26-b538-55903ea98622 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:33.374550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.compute.server_external_events [req-dd58364b-4e7e-4e88-b862-48cdde683015 req-219b928e-029c-4f26-b538-55903ea98622 service nova] Unable to find a host for instance b59a1076-7156-48a7-8e09-75b55aac1a27. Dropping event network-vif-unplugged {{(pid=116349) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 27 01:27:33.376252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-dd58364b-4e7e-4e88-b862-48cdde683015 req-219b928e-029c-4f26-b538-55903ea98622 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024910 Oct 27 01:27:33.376252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 541/1109] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 01:27:33.548392 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:33.548992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:33.554778 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:33.555213 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:33.555955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:33.556402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:33.679518 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:33.686796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-58bb7bde-0973-4d56-a992-7e7d489393cf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1518 microversion: 2.1 time: 0.141990 Oct 27 01:27:33.687287 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 569/1110] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:33 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1518 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:34.346258 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:34.346899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:34.353520 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:34.354212 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:34.354979 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:34.355414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:34.476043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:34.483767 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b4d62a3e-e467-42ac-94a7-5e498ad8c2a6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1502 microversion: 2.1 time: 0.141214 Oct 27 01:27:34.484645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 542/1111] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:34 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:34.703102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:34.703706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:34.709857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:34.710330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:34.711080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:34.711501 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:34.833263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:34.840722 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ba53ba31-c456-4761-9fd2-c0d586cfd2bd tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1518 microversion: 2.1 time: 0.141262 Oct 27 01:27:34.841282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 570/1112] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:34 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1518 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:35.500079 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:35.501231 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:35.501364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-dd04ed7c-5ef3-47ad-bbd5-e8bb2954be17 req-0392409b-65bf-414b-8106-0fd25996eafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6149ea3b-b9fc-4e84-ba35-260a1169c3cc", "name": "network-vif-deleted", "tag": "943434cc-fcd8-41b9-9052-099dfa003944"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:35.503186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:35.503186 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:27:35.508008 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:35.508686 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:35.509963 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:35.510567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:35.511320 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dd04ed7c-5ef3-47ad-bbd5-e8bb2954be17 req-0392409b-65bf-414b-8106-0fd25996eafc service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:35.511877 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-dd04ed7c-5ef3-47ad-bbd5-e8bb2954be17 req-0392409b-65bf-414b-8106-0fd25996eafc service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:35.524953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-dd04ed7c-5ef3-47ad-bbd5-e8bb2954be17 req-0392409b-65bf-414b-8106-0fd25996eafc service nova] Creating event network-vif-deleted:943434cc-fcd8-41b9-9052-099dfa003944 for instance 6149ea3b-b9fc-4e84-ba35-260a1169c3cc on hv-cinder-81556 Oct 27 01:27:35.531167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-dd04ed7c-5ef3-47ad-bbd5-e8bb2954be17 req-0392409b-65bf-414b-8106-0fd25996eafc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Oct 27 01:27:35.532216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 571/1113] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:35.570081 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:35.578134 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e93aff6d-9b06-418f-9d51-89f63f428ea6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1460 microversion: 2.1 time: 0.081789 Oct 27 01:27:35.589714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 543/1114] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:35 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:35.859401 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:35.860123 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:35.866134 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:35.866577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:35.867339 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:35.867769 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:35.996038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:36.003757 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-fd421ad5-34aa-40e5-9e28-3f5ab51510e1 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1518 microversion: 2.1 time: 0.148754 Oct 27 01:27:36.004347 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 572/1115] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:35 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:36.595052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:36.595787 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:36.604052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:36.604702 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:36.605870 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:36.606327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:36.639703 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:36.640228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:36.640665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lazy-loading 'fault' on Instance uuid 6149ea3b-b9fc-4e84-ba35-260a1169c3cc {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:27:36.683402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:36.690450 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4cc35f55-6b51-437a-8408-07becb483f7d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 200 len: 1303 microversion: 2.1 time: 0.098984 Oct 27 01:27:36.691032 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 544/1116] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:36 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:37.020644 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:37.022125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:37.029931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:37.030451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:37.031278 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:37.031723 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:37.164902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:37.172651 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-581e8ba4-0123-4258-b68a-426ee10c39c8 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1518 microversion: 2.1 time: 0.155959 Oct 27 01:27:37.173205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 573/1117] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:37 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:37.707509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:37.708085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 6149ea3b-b9fc-4e84-ba35-260a1169c3cc] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:37.714317 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:37.714753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:37.715497 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:37.715921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:37.729235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] HTTP exception thrown: Instance 6149ea3b-b9fc-4e84-ba35-260a1169c3cc could not be found. Oct 27 01:27:37.729796 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Returning 404 to user: Instance 6149ea3b-b9fc-4e84-ba35-260a1169c3cc could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:27:37.730614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cea5257f-fac8-4d1b-853c-239bd3b66b74 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc" status: 404 len: 111 microversion: 2.1 time: 0.026720 Oct 27 01:27:37.731128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 545/1118] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:37 2021] GET /compute/v2.1/servers/6149ea3b-b9fc-4e84-ba35-260a1169c3cc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:27:37.777275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1517489749", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "baadc2e5-ef47-411c-b34f-076291332e36"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:37.826659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] validate_networks() for [('baadc2e5-ef47-411c-b34f-076291332e36', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:27:38.170528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:27:38.171063 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:27:38.171437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:27:38.171870 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:27:38.172281 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:27:38.182187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:38.183446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:38.183720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:38.184375 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:38.188760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:38.189386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:38.195147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:38.195587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:38.196344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:38.196772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:38.202104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Getting quotas for project ca625749d153471ea9f389ce0cb40803. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:27:38.206003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Getting quotas for user 1df7faf4f8de4ae3b22a0b393dd970df and project ca625749d153471ea9f389ce0cb40803. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:27:38.217125 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:27:38.219520 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:27:38.319142 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:38.327271 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4289adc1-526c-49c6-9314-1476e665d1e2 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.142107 Oct 27 01:27:38.327830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 546/1119] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:38 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:38.425628 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-244897c8-3158-41ed-ade8-3738d6cc019d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651922 Oct 27 01:27:38.426322 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 574/1120] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:27:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:27:38.436635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bee996de-dc5a-495b-b333-076b236c0669 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:38.437257 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bee996de-dc5a-495b-b333-076b236c0669 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:38.489891 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bee996de-dc5a-495b-b333-076b236c0669 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:38.497243 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bee996de-dc5a-495b-b333-076b236c0669 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1214 microversion: 2.1 time: 0.064480 Oct 27 01:27:38.497802 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 547/1121] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:38 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:39.344669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:39.345266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:39.351849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:39.352289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:39.353037 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:39.353525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:39.475833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:39.483943 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e1785e01-b5ac-4322-bec5-2d8774c31ecf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.143032 Oct 27 01:27:39.484524 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 575/1122] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:39 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:39.514015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:39.514641 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:39.521538 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:39.521981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:39.522960 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:39.523310 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:39.580945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:39.588784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-e8c88b4f-7e3d-4d77-a456-6403ec78e3f2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1218 microversion: 2.1 time: 0.079151 Oct 27 01:27:39.589342 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 548/1123] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:39 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:40.500885 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:40.501551 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:40.507814 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:40.508325 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:40.509082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:40.509563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:40.606344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:40.606948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:40.613479 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:40.613931 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:40.614732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:40.615326 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:40.641697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:40.651678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7f1be56e-350d-45c0-944a-2dec51852600 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.154362 Oct 27 01:27:40.652291 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 576/1124] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:40 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:40.695724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:40.703490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1685dbd0-bc0e-44e5-801e-7318bcedfc98 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1218 microversion: 2.1 time: 0.101528 Oct 27 01:27:40.704272 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 549/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:40 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:41.669078 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:41.670436 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:41.676980 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:41.677509 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:41.678423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:41.678937 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:41.720440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:41.721061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:41.728102 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:41.728699 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:41.729549 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:41.730139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:41.820123 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:41.826128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-caa0c775-4f0e-4d92-9ce3-c9954a8efdb7 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1274 microversion: 2.1 time: 0.109210 Oct 27 01:27:41.826707 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 550/1126] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:41 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:41.831669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:41.839117 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ff33e32a-679f-4e46-b3e8-b3218c90da90 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.174355 Oct 27 01:27:41.839678 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 577/1127] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:41 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:42.843260 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:42.844325 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:42.850889 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:42.851290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:42.852052 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:42.852474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:42.856712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:42.857341 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:42.863441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:42.863890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:42.864639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:42.865066 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:43.029741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:43.036763 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:43.036927 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ec62261c-32c2-4565-8976-923eddbd488f tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.197651 Oct 27 01:27:43.037714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 551/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:42 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:43.044921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-16c0a215-89a4-4bf2-bff6-3abdb7660a72 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.192511 Oct 27 01:27:43.045482 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 578/1129] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:42 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:44.053656 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:44.054319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:44.061235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:44.061681 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:44.061875 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:44.062481 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:44.062604 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:44.062910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:44.068514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:44.068952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:44.069701 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:44.070155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:44.241139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:44.249003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-291bfd6c-39ac-4161-863b-2bcd3f5b0b2d tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.198989 Oct 27 01:27:44.249321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:44.249569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 552/1130] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:44 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:44.256631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d9a82c78-7be6-479d-8739-a6119d69df0a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.198304 Oct 27 01:27:44.257188 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 579/1131] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:44 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:45.266235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:45.266841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:45.273262 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:45.278709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:45.279192 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:45.279286 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:45.279376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:45.279376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:45.281473 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:45.282061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:45.282876 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:45.283383 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:45.464345 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:45.473016 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-70a0958c-7c33-4fd6-ada5-801d1f953f6f tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.202859 Oct 27 01:27:45.483448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:45.484175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 580/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:45 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:45.486785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-148e5cb4-bada-4f0c-a580-72cced55bb71 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.224233 Oct 27 01:27:45.487344 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 553/1133] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:45 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:45.941323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-86dd3b0d-1757-47b0-ac45-24848f8f70b8 req-3e60e840-b61c-4c73-9f27-515eaaae698a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bbafc0e-537e-4ce2-9c1c-6387369da5dd", "tag": "88490fae-c0ca-4aad-8138-3081818b3331"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:45.941323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:45.941323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:27:45.950327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-86dd3b0d-1757-47b0-ac45-24848f8f70b8 req-3e60e840-b61c-4c73-9f27-515eaaae698a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:45.950726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-86dd3b0d-1757-47b0-ac45-24848f8f70b8 req-3e60e840-b61c-4c73-9f27-515eaaae698a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:45.967429 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-86dd3b0d-1757-47b0-ac45-24848f8f70b8 req-3e60e840-b61c-4c73-9f27-515eaaae698a service nova] Creating event network-changed:88490fae-c0ca-4aad-8138-3081818b3331 for instance 9bbafc0e-537e-4ce2-9c1c-6387369da5dd on hv-cinder-81556 Oct 27 01:27:45.974646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-86dd3b0d-1757-47b0-ac45-24848f8f70b8 req-3e60e840-b61c-4c73-9f27-515eaaae698a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043247 Oct 27 01:27:45.975058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 581/1134] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:46.490399 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:46.491006 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:46.497998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:46.503941 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:46.504639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:46.511815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:46.512263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:46.513083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:46.513561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:46.514733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:46.515170 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:46.519523 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:46.700982 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:46.707241 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:46.708981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dad5bbd4-ae64-4c62-966d-4b9dc301d13a tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.222482 Oct 27 01:27:46.709874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 554/1135] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:46 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:46.711432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-01cd8618-85fc-4021-92c7-df1b7618a5af tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.211490 Oct 27 01:27:46.712963 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 582/1136] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:46 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:47.727294 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:47.728343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:47.729337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:47.729965 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:47.734801 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:47.735241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:47.735997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:47.736244 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:47.736423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:47.736692 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:47.737450 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:47.737881 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:47.917267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:47.922181 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:47.924467 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-97a54746-a23a-4cae-9463-4337b0ce73b8 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.199570 Oct 27 01:27:47.925031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 583/1137] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:47 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:47.929819 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-df23aaee-5526-4354-bbb4-b44a1a7886cb tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.206299 Oct 27 01:27:47.930491 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 555/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:47 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:48.940393 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:48.941082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:48.945937 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:48.946646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:48.947458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:48.947907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:48.948673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:48.949105 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:48.952944 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:48.953376 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:48.954160 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:48.954587 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:49.122857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:49.127473 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:49.130144 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-eeab8430-04bc-4114-9346-afa022a03387 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.193317 Oct 27 01:27:49.130904 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 584/1139] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:48 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:49.134831 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6514229b-781a-4482-acfb-6ac8c22365d9 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.192626 Oct 27 01:27:49.135390 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 556/1140] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:48 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:50.146869 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:50.147563 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:50.151525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:50.152123 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:50.155200 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:50.155645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:50.156407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:50.156969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:50.158424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:50.159159 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:50.159818 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:50.160252 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:50.341447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:50.348885 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bf7bc380-f36b-441b-8316-9934fc80a61e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.205710 Oct 27 01:27:50.349296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:50.349765 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 585/1141] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:50 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:50.357525 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-26184b13-f2c7-4ac5-a932-8e76ee61d525 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.210054 Oct 27 01:27:50.358133 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 557/1142] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:50 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:51.366527 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:51.367061 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:51.373994 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:51.374468 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:51.374991 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:51.375391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:51.375672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:51.375785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:51.381851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:51.382391 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:51.383158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:51.383601 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:51.564423 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:51.571114 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:51.571924 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0e21e2ae-1b45-4008-8665-5e7d27536687 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.208934 Oct 27 01:27:51.572752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 586/1143] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:51 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:51.578487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-aeecd84a-88f5-4a90-ad0f-23e8d20a9d22 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.207208 Oct 27 01:27:51.579045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 558/1144] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:51 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:52.021150 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-26efb197-1972-4bb2-95fb-079d10545911 req-a14533d3-a37b-4534-8405-bd52f52e316a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "name": "network-vif-plugged", "status": "completed", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:52.022754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:52.022754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:27:52.030342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-26efb197-1972-4bb2-95fb-079d10545911 req-a14533d3-a37b-4534-8405-bd52f52e316a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:52.030791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-26efb197-1972-4bb2-95fb-079d10545911 req-a14533d3-a37b-4534-8405-bd52f52e316a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:52.041609 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-26efb197-1972-4bb2-95fb-079d10545911 req-a14533d3-a37b-4534-8405-bd52f52e316a service nova] Creating event network-vif-plugged:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:27:52.046634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-26efb197-1972-4bb2-95fb-079d10545911 req-a14533d3-a37b-4534-8405-bd52f52e316a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029312 Oct 27 01:27:52.047230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 587/1145] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:52.588747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:52.590756 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:52.596432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:52.597448 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:52.598957 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:52.599404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:52.600182 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:52.600621 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:52.605944 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:52.605944 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:52.606245 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:52.606743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:52.775172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:52.781486 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:52.783115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c8976ec6-68cd-4e0e-b543-763f5e5b531e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1574 microversion: 2.1 time: 0.190989 Oct 27 01:27:52.783791 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 588/1146] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:52 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:52.788833 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d1ba17bc-ecdd-4cc6-99ea-ff3b9f7a6bb2 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.204093 Oct 27 01:27:52.789385 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 559/1147] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:52 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:53.801156 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:53.801771 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:53.806354 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:53.807106 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:53.809390 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:53.809956 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:53.810766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:53.811203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:53.817392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:53.817859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:53.818646 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:53.819188 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:54.004536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:54.007576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:54.017150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ff032b6f-beb7-436d-a2dc-29b825907ae6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.213840 Oct 27 01:27:54.017150 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 560/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:53 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:54.017388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d67eaad3-1c81-4bc1-aa3c-1cf557da4001 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1561 microversion: 2.1 time: 0.219985 Oct 27 01:27:54.018621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 589/1149] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:53 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:54.060948 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-629a0edd-0bed-4d76-887c-1c8c6e82b0a8 req-0d9ac359-93a6-4b10-ba96-f1e1d6f0416b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbafc0e-537e-4ce2-9c1c-6387369da5dd", "name": "network-vif-plugged", "status": "completed", "tag": "88490fae-c0ca-4aad-8138-3081818b3331"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:54.062405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:54.062405 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:27:54.069906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-629a0edd-0bed-4d76-887c-1c8c6e82b0a8 req-0d9ac359-93a6-4b10-ba96-f1e1d6f0416b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:54.070470 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-629a0edd-0bed-4d76-887c-1c8c6e82b0a8 req-0d9ac359-93a6-4b10-ba96-f1e1d6f0416b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:54.078529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:54.079025 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:54.082543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-629a0edd-0bed-4d76-887c-1c8c6e82b0a8 req-0d9ac359-93a6-4b10-ba96-f1e1d6f0416b service nova] Creating event network-vif-plugged:88490fae-c0ca-4aad-8138-3081818b3331 for instance 9bbafc0e-537e-4ce2-9c1c-6387369da5dd on hv-cinder-81556 Oct 27 01:27:54.084783 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:54.085221 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:54.087262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:54.087784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:54.088186 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-629a0edd-0bed-4d76-887c-1c8c6e82b0a8 req-0d9ac359-93a6-4b10-ba96-f1e1d6f0416b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 Oct 27 01:27:54.088798 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 561/1150] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:54.182695 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lazy-loading 'services' on Instance uuid 359ae674-d03a-4657-a1f6-6bcd0078dca9 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:27:54.431342 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2b9e4b27-919f-422b-8846-aef3efe0a778 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "DELETE /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9/os-volume_attachments/1e2e66d9-4331-42e5-a022-16cdbaa47b3e" status: 202 len: 0 microversion: 2.1 time: 0.355943 Oct 27 01:27:54.431951 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 590/1151] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:27:54 2021] DELETE /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9/os-volume_attachments/1e2e66d9-4331-42e5-a022-16cdbaa47b3e => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:27:55.034612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:55.035324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:55.041847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:55.042255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:55.043015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:55.043447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:55.162529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:55.170351 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-28a06aef-63de-4844-83e7-139ce05cdd2c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1314 microversion: 2.1 time: 0.140220 Oct 27 01:27:55.170923 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 562/1152] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:55 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:56.188058 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:56.188749 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:56.195204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.195643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:56.197129 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.197564 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:56.317553 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:56.325113 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ce468999-2e78-4c07-b1df-2e98016b7990 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1497 microversion: 2.1 time: 0.141175 Oct 27 01:27:56.325680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 591/1153] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:56 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:56.591696 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:56.592201 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:56.598706 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.599151 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:56.599990 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.600423 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:56.625983 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:27:56.911050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8264bbc5-a65d-417b-9fc8-4e6582062820 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "DELETE /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 204 len: 0 microversion: 2.1 time: 0.323899 Oct 27 01:27:56.911645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 563/1154] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:27:56 2021] DELETE /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:27:56.920355 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:56.920959 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:56.926699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.927137 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:56.927909 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:56.928335 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:57.050008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:57.057673 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-18626b82-8e1c-4eed-b7e7-76251d589578 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1514 microversion: 2.1 time: 0.140860 Oct 27 01:27:57.058205 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 592/1155] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:56 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:57.194115 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:57.194719 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:57.201055 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:57.201503 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:57.202309 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:57.202742 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:57.227223 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:27:57.591372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3f29da10-89e4-4fe6-9cd1-351a0cc9cf6e tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 204 len: 0 microversion: 2.1 time: 0.400994 Oct 27 01:27:57.591966 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 564/1156] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:27:57 2021] DELETE /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:27:57.600470 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:57.601076 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:57.607535 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:57.607978 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:57.608744 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:57.609172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:57.730103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:57.737249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1113f13e-185c-4986-bf83-2451a58a043c tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1503 microversion: 2.1 time: 0.140856 Oct 27 01:27:57.737812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 593/1157] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:57 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1503 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:58.075404 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:58.076112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:58.082296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:58.082741 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:58.083492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:58.083922 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:58.201232 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:58.208493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-44b40484-b865-4945-b0bf-b9b84993b9e9 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1514 microversion: 2.1 time: 0.137266 Oct 27 01:27:58.209059 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 565/1158] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:58 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:58.754318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:58.755018 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:58.762048 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:58.762500 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:58.763263 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:58.763698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:58.888558 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:58.895798 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c143227a-b1c3-42cb-b800-95a390e6f5d5 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1503 microversion: 2.1 time: 0.145183 Oct 27 01:27:58.896359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 594/1159] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:58 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:59.225534 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:59.226209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:59.232909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:59.235610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:59.235610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:59.235610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:59.254089 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-6fc4601b-ae31-4c42-a030-97993ac83c92 req-178ad7b1-a97f-4879-a5d6-0d7b493c4474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359ae674-d03a-4657-a1f6-6bcd0078dca9", "name": "network-vif-deleted", "tag": "7de1aad2-7e54-46f1-b67e-42a166518942"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:59.256145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:27:59.256145 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:27:59.265103 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-6fc4601b-ae31-4c42-a030-97993ac83c92 req-178ad7b1-a97f-4879-a5d6-0d7b493c4474 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:59.265786 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-6fc4601b-ae31-4c42-a030-97993ac83c92 req-178ad7b1-a97f-4879-a5d6-0d7b493c4474 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:59.277616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-6fc4601b-ae31-4c42-a030-97993ac83c92 req-178ad7b1-a97f-4879-a5d6-0d7b493c4474 service nova] Creating event network-vif-deleted:7de1aad2-7e54-46f1-b67e-42a166518942 for instance 359ae674-d03a-4657-a1f6-6bcd0078dca9 on hv-cinder-81556 Oct 27 01:27:59.282398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-6fc4601b-ae31-4c42-a030-97993ac83c92 req-178ad7b1-a97f-4879-a5d6-0d7b493c4474 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Oct 27 01:27:59.283447 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 595/1160] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:27:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:59.306717 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:59.314316 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2e4e4604-b948-44cb-8dd7-f5d97c54e2d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1472 microversion: 2.1 time: 0.092679 Oct 27 01:27:59.314893 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 566/1161] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:59 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:59.914852 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:59.916400 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:27:59.923333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:59.923775 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:27:59.924653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:27:59.925081 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:00.051080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:00.058570 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-db894f52-b0cf-471d-bf84-0aa8d92f0132 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1503 microversion: 2.1 time: 0.149388 Oct 27 01:28:00.059371 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 596/1162] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:27:59 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:00.336693 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:00.337517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:00.343732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:00.344175 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:00.344938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:00.345366 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:00.377108 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:00.377465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:00.377906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lazy-loading 'fault' on Instance uuid 359ae674-d03a-4657-a1f6-6bcd0078dca9 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:28:00.416270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:00.423447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ac00880f-e9e4-43b1-803b-5f25808cd506 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 200 len: 1309 microversion: 2.1 time: 0.090587 Oct 27 01:28:00.424008 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 567/1163] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:00 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:01.075733 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:01.076333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:01.082697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.083136 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.083889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.084312 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.114881 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.115330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.115774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lazy-loading 'fault' on Instance uuid 9bbafc0e-537e-4ce2-9c1c-6387369da5dd {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:28:01.158306 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df7faf4f8de4ae3b22a0b393dd970df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca625749d153471ea9f389ce0cb40803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:01.166321 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-10732852-0fae-4cf0-a62a-c3fc333ce5b6 tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 200 len: 1304 microversion: 2.1 time: 0.094404 Oct 27 01:28:01.166887 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 597/1164] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:01 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:01.296996 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-2f8aa121-d5c3-4e90-9b6b-7b8b7f61c265 req-8a25db50-80a4-4655-943e-aaed33756523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbafc0e-537e-4ce2-9c1c-6387369da5dd", "name": "network-vif-deleted", "tag": "88490fae-c0ca-4aad-8138-3081818b3331"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:01.298569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:01.298569 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:28:01.305213 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2f8aa121-d5c3-4e90-9b6b-7b8b7f61c265 req-8a25db50-80a4-4655-943e-aaed33756523 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.305654 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-2f8aa121-d5c3-4e90-9b6b-7b8b7f61c265 req-8a25db50-80a4-4655-943e-aaed33756523 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.315812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-2f8aa121-d5c3-4e90-9b6b-7b8b7f61c265 req-8a25db50-80a4-4655-943e-aaed33756523 service nova] Creating event network-vif-deleted:88490fae-c0ca-4aad-8138-3081818b3331 for instance 9bbafc0e-537e-4ce2-9c1c-6387369da5dd on hv-cinder-81556 Oct 27 01:28:01.320711 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-2f8aa121-d5c3-4e90-9b6b-7b8b7f61c265 req-8a25db50-80a4-4655-943e-aaed33756523 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027270 Oct 27 01:28:01.324714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 568/1165] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:01.440458 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:01.440993 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 359ae674-d03a-4657-a1f6-6bcd0078dca9] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:01.446833 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.447276 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.448039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:01.448477 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:01.461029 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] HTTP exception thrown: Instance 359ae674-d03a-4657-a1f6-6bcd0078dca9 could not be found. Oct 27 01:28:01.462244 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Returning 404 to user: Instance 359ae674-d03a-4657-a1f6-6bcd0078dca9 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:28:01.463091 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-d8a1f808-7e16-4fe9-ad9a-5f55ea8e7503 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9" status: 404 len: 111 microversion: 2.1 time: 0.026420 Oct 27 01:28:01.463614 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 598/1166] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:01 2021] GET /compute/v2.1/servers/359ae674-d03a-4657-a1f6-6bcd0078dca9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:02.186006 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:02.186726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] [instance: 9bbafc0e-537e-4ce2-9c1c-6387369da5dd] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:02.193635 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:02.194100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:02.194856 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:02.195278 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:02.210720 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] HTTP exception thrown: Instance 9bbafc0e-537e-4ce2-9c1c-6387369da5dd could not be found. Oct 27 01:28:02.211510 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] Returning 404 to user: Instance 9bbafc0e-537e-4ce2-9c1c-6387369da5dd could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:28:02.212467 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6c43e28a-2d06-4f69-b0a5-44989c93869a tempest-VolumesActionsTest-1400832134 tempest-VolumesActionsTest-1400832134-project] 10.222.0.32 "GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd" status: 404 len: 111 microversion: 2.1 time: 0.032969 Oct 27 01:28:02.213183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 569/1167] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:02 2021] GET /compute/v2.1/servers/9bbafc0e-537e-4ce2-9c1c-6387369da5dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:13.966808 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-469752157", "imageRef": "619c9470-fce8-4883-b2de-a52fb2b2e44f", "flavorRef": "452", "networks": [{"uuid": "db7a7956-5753-48f1-84a3-719e54952fae"}]}} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:14.027752 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.network.neutron [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] validate_networks() for [('db7a7956-5753-48f1-84a3-719e54952fae', None, None, None, None, None)] {{(pid=116348) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:28:14.396111 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Flavor limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:28:14.397009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Image limits 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:28:14.397680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Flavor pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:28:14.398203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Image pref 0:0:0 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:28:14.398812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.virt.hardware [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:28:14.409894 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:14.410503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:14.411455 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:14.411958 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:14.431489 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Getting quotas for project 0201f20f8a2e46e6a8ceb7bccf7659df. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:28:14.435498 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.quota [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Getting quotas for user a6fb31f457cb4c268d6f4e06bf5ee703 and project 0201f20f8a2e46e6a8ceb7bccf7659df. Resources: {'ram', 'cores', 'instances'} {{(pid=116348) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:28:14.447030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Going to run 1 instances... {{(pid=116348) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:28:14.449532 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619c9470-fce8-4883-b2de-a52fb2b2e44f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:28:14.588990 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b5a00158-7752-442b-973f-5f0d461a06d4 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625353 Oct 27 01:28:14.594836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 599/1168] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:28:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:28:14.600459 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0a035ea6-ac55-409e-b132-f0a4a65cc9f5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:14.601694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0a035ea6-ac55-409e-b132-f0a4a65cc9f5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:14.691321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-0a035ea6-ac55-409e-b132-f0a4a65cc9f5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:14.699619 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0a035ea6-ac55-409e-b132-f0a4a65cc9f5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1218 microversion: 2.1 time: 0.103302 Oct 27 01:28:14.700567 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 570/1169] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:14 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:15.716794 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ab84cf39-cb67-4eb9-9907-84ff5f9e72d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:15.717463 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ab84cf39-cb67-4eb9-9907-84ff5f9e72d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:15.772143 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ab84cf39-cb67-4eb9-9907-84ff5f9e72d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:15.778889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ab84cf39-cb67-4eb9-9907-84ff5f9e72d7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1218 microversion: 2.1 time: 0.065998 Oct 27 01:28:15.779531 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 600/1170] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:15 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:16.798841 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:16.804862 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:16.815743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:16.816471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:16.817263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:16.817724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:16.880101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:16.889085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bdaeb914-00c9-4423-8aff-f34e94587177 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1270 microversion: 2.1 time: 0.093814 Oct 27 01:28:16.889665 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 571/1171] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:16 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:17.908767 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:17.910750 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:17.917045 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:17.917495 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:17.918289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:17.918720 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:17.989879 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:17.998299 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-e555be44-230c-404c-80e9-1c15086eedae tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1276 microversion: 2.1 time: 0.095117 Oct 27 01:28:17.999314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 601/1172] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:17 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:19.017524 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:19.018631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:19.027890 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:19.028992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:19.029912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:19.030867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:19.370669 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-d81bba54-0ddb-4041-8b51-0c9993abd3fa req-059f0b46-14d1-4c93-96e2-b941bfb51eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58", "tag": "28e2887a-33b3-4216-9682-ccc3e1e40233"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:19.373075 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:19.373075 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:28:19.386262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d81bba54-0ddb-4041-8b51-0c9993abd3fa req-059f0b46-14d1-4c93-96e2-b941bfb51eb3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:19.389577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d81bba54-0ddb-4041-8b51-0c9993abd3fa req-059f0b46-14d1-4c93-96e2-b941bfb51eb3 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:19.408359 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-d81bba54-0ddb-4041-8b51-0c9993abd3fa req-059f0b46-14d1-4c93-96e2-b941bfb51eb3 service nova] Creating event network-changed:28e2887a-33b3-4216-9682-ccc3e1e40233 for instance 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 on hv-cinder-81556 Oct 27 01:28:19.419836 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-d81bba54-0ddb-4041-8b51-0c9993abd3fa req-059f0b46-14d1-4c93-96e2-b941bfb51eb3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052634 Oct 27 01:28:19.424740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 602/1173] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:28:19.437323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:19.445147 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cfae0b71-85e5-45c9-bab5-f389689a56ac tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.432636 Oct 27 01:28:19.453101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 572/1174] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:19 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:20.463591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:20.464973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:20.472508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:20.473519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:20.474519 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:20.475164 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:20.622070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:20.630975 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-70ec9f22-6627-4df4-8a96-faf153a9428f tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.172186 Oct 27 01:28:20.632093 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 603/1175] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:20 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:21.647352 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:21.647977 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:21.656229 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:21.656683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:21.657492 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:21.657929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:21.786552 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:21.795424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-fd396dcb-db56-4aa3-967f-ae1c3f3979b7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.151789 Oct 27 01:28:21.796026 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 573/1176] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:21 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:22.812507 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:22.813030 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:22.819679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:22.820211 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:22.821074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:22.821503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:22.954914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:22.963270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cceaaaf9-65a0-4d33-bfb0-fc4b494f9b9e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.154456 Oct 27 01:28:22.964410 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 604/1177] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:22 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:23.999911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:23.999911 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:24.007854 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:24.008303 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:24.013821 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:24.014494 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:24.167090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:24.173085 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d77c8299-96bd-4bc7-a1e4-937596231dfd tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.196069 Oct 27 01:28:24.174068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 574/1178] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:23 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:25.190264 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:25.190921 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:25.197796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:25.198282 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:25.199039 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:25.199464 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:25.320676 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:25.328412 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c8206112-da11-498e-a3d5-a73b0827f73c tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.142195 Oct 27 01:28:25.328980 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 605/1179] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:25 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:26.252967 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-972d7c84-8ec3-440e-ba24-abac3534ec50 req-2e0d399e-c061-46ae-b6f8-224237709321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58", "name": "network-vif-plugged", "status": "completed", "tag": "28e2887a-33b3-4216-9682-ccc3e1e40233"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:26.255189 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:26.255189 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:28:26.265543 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-972d7c84-8ec3-440e-ba24-abac3534ec50 req-2e0d399e-c061-46ae-b6f8-224237709321 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:26.265987 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-972d7c84-8ec3-440e-ba24-abac3534ec50 req-2e0d399e-c061-46ae-b6f8-224237709321 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:26.277604 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-972d7c84-8ec3-440e-ba24-abac3534ec50 req-2e0d399e-c061-46ae-b6f8-224237709321 service nova] Creating event network-vif-plugged:28e2887a-33b3-4216-9682-ccc3e1e40233 for instance 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 on hv-cinder-81556 Oct 27 01:28:26.282642 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-972d7c84-8ec3-440e-ba24-abac3534ec50 req-2e0d399e-c061-46ae-b6f8-224237709321 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Oct 27 01:28:26.283323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 575/1180] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:26.345398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:26.346374 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:26.354108 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:26.354549 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:26.355314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:26.355742 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:26.483639 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:26.490928 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-bd9db61b-32ec-41b6-999c-3224bfcf8a68 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.149338 Oct 27 01:28:26.491626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 606/1181] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:26 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:27.508823 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:27.509499 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:27.515496 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:27.515933 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:27.516682 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:27.517103 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:27.636860 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:27.644203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f5a6c201-83a6-466e-85b8-0834461a1ba7 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1318 microversion: 2.1 time: 0.139972 Oct 27 01:28:27.644760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 576/1182] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:27 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:28.660364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:28.660971 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:28.667885 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:28.668330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:28.669100 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:28.669529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:28.789330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:28.797020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c35a8c78-8554-42d2-a447-a2d0bb7fbc1e tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1508 microversion: 2.1 time: 0.140364 Oct 27 01:28:28.797592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 607/1183] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:28 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:28.813416 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78d0ad25-fded-4049-8cdd-f221abd00cf1", "device": "/dev/sdb"}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:28.820340 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:28.821249 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:28.821695 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:28.822484 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:28.822910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:29.602645 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d1754ec4-a968-46f4-a928-552450abdc23 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "POST /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792232 Oct 27 01:28:29.603464 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 577/1184] 10.222.0.32 () {60 vars in 1322 bytes} [Wed Oct 27 01:28:28 2021] POST /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:41.183472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:41.184059 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:41.190258 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:41.190702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:41.191464 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:41.191898 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:41.215658 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:28:41.505805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-311244a3-c887-43b7-9e48-b6ce5b38cffb tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 204 len: 0 microversion: 2.1 time: 0.325752 Oct 27 01:28:41.506418 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 608/1185] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:28:41 2021] DELETE /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:28:41.515644 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:41.516328 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:41.522505 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:41.523673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:41.523673 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:41.524106 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:41.644714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:41.652576 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-3e579bbf-4515-45ef-923e-d130242c308f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1576 microversion: 2.1 time: 0.141834 Oct 27 01:28:41.653135 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 578/1186] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:41 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:42.670611 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:42.671311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:42.677479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:42.677926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:42.678715 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:42.679156 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:42.803949 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:42.810940 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-38a7a428-45c5-4b7c-a73a-db9c04d61fb0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1576 microversion: 2.1 time: 0.144877 Oct 27 01:28:42.821074 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 609/1187] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:42 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:43.827651 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:43.828256 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:43.834438 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:43.834879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:43.835633 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:43.836054 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:43.958163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:43.966148 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-807d0160-9b27-4d0b-bc05-2ef8822b5368 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1576 microversion: 2.1 time: 0.142094 Oct 27 01:28:43.966716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 579/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:43 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:44.983391 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:44.983992 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:44.990404 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:44.990844 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:44.991597 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:44.992020 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:45.110585 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:45.118115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1ffd6d31-9d8d-47e9-8db2-a1d369fb90c8 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1576 microversion: 2.1 time: 0.138337 Oct 27 01:28:45.118685 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 610/1189] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:44 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:46.136063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:46.137930 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:46.144462 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:46.144906 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:46.145669 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:46.146133 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:46.281806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:46.290045 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2ca3a141-893e-4e6d-ba70-5978a55b4198 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1576 microversion: 2.1 time: 0.157726 Oct 27 01:28:46.291173 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 580/1190] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:46 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:47.003525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-cdb29a9e-333b-4f96-878f-1ae17bd83042 req-2652ab7f-9346-4253-a6cf-5fab70bf0278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a39a6a3-72c4-4c0d-8bad-2971fbebc302", "name": "network-vif-deleted", "tag": "b47b9ded-707a-4e56-a5c7-2e7f5cee57d1"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:47.005528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:47.005528 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:28:47.013680 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cdb29a9e-333b-4f96-878f-1ae17bd83042 req-2652ab7f-9346-4253-a6cf-5fab70bf0278 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:47.018210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cdb29a9e-333b-4f96-878f-1ae17bd83042 req-2652ab7f-9346-4253-a6cf-5fab70bf0278 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:47.026015 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-cdb29a9e-333b-4f96-878f-1ae17bd83042 req-2652ab7f-9346-4253-a6cf-5fab70bf0278 service nova] Creating event network-vif-deleted:b47b9ded-707a-4e56-a5c7-2e7f5cee57d1 for instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 on hv-cinder-81556 Oct 27 01:28:47.031444 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-cdb29a9e-333b-4f96-878f-1ae17bd83042 req-2652ab7f-9346-4253-a6cf-5fab70bf0278 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Oct 27 01:28:47.032056 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 611/1191] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:47.307862 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:47.309272 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:47.315907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:47.316553 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:47.317319 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:47.317814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:47.380834 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:47.385752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-54ad6159-f0c4-4c00-aa28-f41c2ac88015 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 200 len: 1225 microversion: 2.1 time: 0.081533 Oct 27 01:28:47.386339 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 581/1192] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:47 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:48.404295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:48.404991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:48.411336 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:48.411779 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:48.412544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:48.412970 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:48.425952 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] HTTP exception thrown: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. Oct 27 01:28:48.426592 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Returning 404 to user: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:28:48.427441 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-5fcc24b2-fb30-4867-b581-fdeaa3c1bfc1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 404 len: 111 microversion: 2.1 time: 0.028379 Oct 27 01:28:48.427969 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 612/1193] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:48 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:48.521737 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-800618628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2129270094", "security_groups": [{"name": "tempest-secgroup-smoke-461718875"}], "block_device_mapping_v2": [{"uuid": "cdcc4b4c-ab3d-47d9-acab-69709422805a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6e401b1-a90b-4326-8b49-61e14b7b154a"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:48.623618 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] validate_networks() for [('d6e401b1-a90b-4326-8b49-61e14b7b154a', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:28:48.986442 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:28:48.986861 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:28:48.987321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:28:48.987716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:28:48.988112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:28:48.997372 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:48.997812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:48.998657 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:48.999084 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:49.014715 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:28:49.018522 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for user eb7fe651d1c84f28a9267a543d0e2497 and project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:28:49.071918 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:28:49.074017 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdcc4b4c-ab3d-47d9-acab-69709422805a',volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:28:49.644316 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-0eb6b866-64da-47cc-8bc7-e3eae5d426c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.126010 Oct 27 01:28:49.645287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 582/1194] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:28:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:28:49.655991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-2c8b51a4-84af-4754-97c9-765578a0e38f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:49.656602 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-2c8b51a4-84af-4754-97c9-765578a0e38f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:49.709540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-2c8b51a4-84af-4754-97c9-765578a0e38f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:49.717284 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-2c8b51a4-84af-4754-97c9-765578a0e38f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1094 microversion: 2.1 time: 0.066096 Oct 27 01:28:49.718086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 613/1195] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:49 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:50.498337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:50.498851 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:50.505361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:50.505806 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:50.506592 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:50.507019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:50.582163 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lazy-loading 'services' on Instance uuid 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:28:50.735319 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:50.735857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:50.742913 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:50.743406 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:50.744120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:50.744555 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:50.803155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:50.811187 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-22cd4298-a007-464a-8809-04466f7a7c57 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1144 microversion: 2.1 time: 0.079983 Oct 27 01:28:50.811809 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 614/1196] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:50 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:50.829227 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-968113a9-5c72-4ea4-bbbb-c8f8b5c72a15 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58/os-volume_attachments/78d0ad25-fded-4049-8cdd-f221abd00cf1" status: 202 len: 0 microversion: 2.1 time: 0.335222 Oct 27 01:28:50.835928 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 583/1197] 10.222.0.32 () {58 vars in 1415 bytes} [Wed Oct 27 01:28:50 2021] DELETE /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58/os-volume_attachments/78d0ad25-fded-4049-8cdd-f221abd00cf1 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:28:51.828236 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:51.828815 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:51.835034 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:51.835484 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:51.836266 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:51.836695 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:51.916504 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:51.930471 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-36644e72-a39b-43b0-a5e7-f4d96a4a31ed tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1200 microversion: 2.1 time: 0.106496 Oct 27 01:28:51.931121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 615/1198] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:51 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:51.946844 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:51.947724 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:51.955113 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:51.955554 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:51.956323 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:51.956750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:51.984761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:28:52.459993 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-07e4055d-17b0-4c52-95df-fa0d600a71ad tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 204 len: 0 microversion: 2.1 time: 0.517686 Oct 27 01:28:52.460581 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 584/1199] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:28:51 2021] DELETE /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:28:52.469124 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:52.469732 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:52.475855 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:52.476372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:52.477211 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:52.477712 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:52.598197 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:52.605491 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f7c563ab-4c13-45e0-a7d6-c1d30cf220a1 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1514 microversion: 2.1 time: 0.140684 Oct 27 01:28:52.607800 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 616/1200] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:52 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:52.948809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:52.949529 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:52.957535 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:52.957971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:52.958804 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:52.959241 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:53.092743 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:53.101823 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-ec5d5c7b-8f81-4dc7-876e-828683e43f9f tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1277 microversion: 2.1 time: 0.157109 Oct 27 01:28:53.102556 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 585/1201] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:52 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:53.577646 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-d7c981d6-ff2a-44bf-8211-3b9e3cb7be55 req-664c2d25-9c69-4ebe-b63d-9f7ccb08e55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532", "tag": "3f3401c7-6747-49bb-ab1a-bca327762ba3"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:53.580608 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:53.580608 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:28:53.588311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d7c981d6-ff2a-44bf-8211-3b9e3cb7be55 req-664c2d25-9c69-4ebe-b63d-9f7ccb08e55a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:53.588754 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-d7c981d6-ff2a-44bf-8211-3b9e3cb7be55 req-664c2d25-9c69-4ebe-b63d-9f7ccb08e55a service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:53.601747 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-d7c981d6-ff2a-44bf-8211-3b9e3cb7be55 req-664c2d25-9c69-4ebe-b63d-9f7ccb08e55a service nova] Creating event network-changed:3f3401c7-6747-49bb-ab1a-bca327762ba3 for instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 on hv-cinder-81556 Oct 27 01:28:53.609607 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-d7c981d6-ff2a-44bf-8211-3b9e3cb7be55 req-664c2d25-9c69-4ebe-b63d-9f7ccb08e55a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 Oct 27 01:28:53.610221 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 617/1202] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:53.624123 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:53.624762 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:53.631299 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:53.631740 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:53.632518 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:53.632938 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:53.770690 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:53.778969 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2ac98ecb-daa9-412b-9dcb-bf3551444fee tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1514 microversion: 2.1 time: 0.159654 Oct 27 01:28:53.779722 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 586/1203] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:53 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:54.121176 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:54.121867 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:54.128707 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:54.129148 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:54.129905 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:54.130372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:54.252626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:54.260300 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1478ac40-072d-4224-93ef-f2ff0c1c2347 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.143459 Oct 27 01:28:54.260955 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 618/1204] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:54 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:54.796778 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:54.797392 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:54.803614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:54.804056 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:54.804819 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:54.805246 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:54.928597 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:54.936561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1b8b572d-0d3c-4288-aa10-e567745a2edb tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1514 microversion: 2.1 time: 0.143933 Oct 27 01:28:54.937138 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 587/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:54 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:55.280503 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:55.281094 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:55.287314 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.288252 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.288543 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.288968 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.411356 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:55.419364 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b2e25e70-78e5-4a0c-ae51-b66a495f06f7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.142591 Oct 27 01:28:55.419932 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 619/1206] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:55 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:55.624050 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-48a77fa0-523b-4620-bf31-e352a95b4d87 req-850b42f6-00be-486e-a712-99c504f53e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58", "name": "network-vif-deleted", "tag": "28e2887a-33b3-4216-9682-ccc3e1e40233"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:55.625666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:28:55.625666 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:28:55.632745 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-48a77fa0-523b-4620-bf31-e352a95b4d87 req-850b42f6-00be-486e-a712-99c504f53e69 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.633179 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-48a77fa0-523b-4620-bf31-e352a95b4d87 req-850b42f6-00be-486e-a712-99c504f53e69 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.644528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-48a77fa0-523b-4620-bf31-e352a95b4d87 req-850b42f6-00be-486e-a712-99c504f53e69 service nova] Creating event network-vif-deleted:28e2887a-33b3-4216-9682-ccc3e1e40233 for instance 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 on hv-cinder-81556 Oct 27 01:28:55.649447 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-48a77fa0-523b-4620-bf31-e352a95b4d87 req-850b42f6-00be-486e-a712-99c504f53e69 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029143 Oct 27 01:28:55.651345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 588/1207] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:28:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:28:55.954096 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:55.954714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:55.961294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.962048 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.962931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.963729 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.997031 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:55.997474 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:55.997925 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lazy-loading 'fault' on Instance uuid 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:28:56.044185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6fb31f457cb4c268d6f4e06bf5ee703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0201f20f8a2e46e6a8ceb7bccf7659df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:56.051442 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-b834b869-6fea-4d5e-b811-a191b22560c5 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 200 len: 1308 microversion: 2.1 time: 0.102356 Oct 27 01:28:56.052009 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 620/1208] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:55 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:56.437021 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:56.437701 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:56.443971 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:56.444411 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:56.445172 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:56.445601 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:56.570945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:56.578350 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f07f1c31-1043-4da6-ae41-7c70f559cbf7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.146311 Oct 27 01:28:56.579203 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 589/1209] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:56 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:57.068297 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:57.068902 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] [instance: 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:57.075665 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:57.076104 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:57.076851 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:57.077275 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:57.090868 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] HTTP exception thrown: Instance 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 could not be found. Oct 27 01:28:57.091626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] Returning 404 to user: Instance 2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:28:57.092431 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-f3a4098f-4a85-46db-b211-57aaa7c42760 tempest-VolumesSnapshotTestJSON-1818910817 tempest-VolumesSnapshotTestJSON-1818910817-project] 10.222.0.32 "GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58" status: 404 len: 111 microversion: 2.1 time: 0.027829 Oct 27 01:28:57.092951 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 621/1210] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:57 2021] GET /compute/v2.1/servers/2ebf7c3a-a3cb-4dfc-8cf9-b0b41ba6ac58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:57.594577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:57.595441 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:57.602012 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:57.602487 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:57.603296 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:57.603728 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:57.730341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:57.737744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-1a5633d7-fea0-449e-918b-493cc1cdca7a tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.146916 Oct 27 01:28:57.738328 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 590/1211] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:57 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:58.754659 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:58.755681 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:58.761899 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:58.762372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:58.763121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:58.764038 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:58.884167 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:58.892017 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-4f96383e-486c-415a-8a14-e9a6d0e66640 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.141024 Oct 27 01:28:58.892591 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 622/1212] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:58 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:59.912986 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:59.913593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:28:59.919801 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:59.920248 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:28:59.921009 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:28:59.921440 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:00.049095 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:00.056369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cfdca66c-ca01-4ae7-9be7-14c4e028547b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.147076 Oct 27 01:29:00.057015 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 591/1213] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:28:59 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:01.073318 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:01.073918 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:01.080121 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:01.080558 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:01.081303 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:01.081728 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:01.199337 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:01.206537 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cdb291f8-8a37-47b6-acc9-d8cd84697213 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.136921 Oct 27 01:29:01.207097 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 623/1214] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:01 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:02.223572 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:02.224143 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:02.230327 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:02.230772 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:02.231599 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:02.232030 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:02.351960 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:02.359099 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-495bfb3c-86fa-4a0d-9145-814bed4bdf8c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.140158 Oct 27 01:29:02.359655 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 592/1215] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:02 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:03.375379 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:03.375973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:03.382333 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:03.382778 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:03.384626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:03.384626 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:03.507201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:03.514613 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-07b95263-3efa-4a8f-99c5-3df890f776c1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.142878 Oct 27 01:29:03.515175 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 624/1216] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:03 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:04.536511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:04.537107 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:04.543541 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:04.543978 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:04.544732 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:04.545158 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:04.665100 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:04.672341 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2e2275e6-c469-4126-878d-829076b1ec9c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.139652 Oct 27 01:29:04.672903 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 593/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:04 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:05.688826 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:05.689402 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:05.695595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:05.696033 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:05.696780 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:05.697202 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:05.821311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:05.828698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-36bf57d0-01d6-445c-84b2-74d926228280 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.143604 Oct 27 01:29:05.829267 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 625/1218] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:05 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:06.846156 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:06.846694 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:06.853582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:06.854082 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:06.854929 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:06.855355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:06.981781 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:06.989609 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5f299048-a974-41bb-934c-8d3eccebaf76 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.147569 Oct 27 01:29:06.990197 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 594/1219] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:06 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:07.452706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-cc49d18d-b492-4541-927e-ca9a3a6d1645 req-f8577c57-388b-40ee-82a7-004e74a547d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532", "name": "network-vif-plugged", "status": "completed", "tag": "3f3401c7-6747-49bb-ab1a-bca327762ba3"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:07.454702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:07.454702 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:29:07.462613 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cc49d18d-b492-4541-927e-ca9a3a6d1645 req-f8577c57-388b-40ee-82a7-004e74a547d6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:07.463054 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-cc49d18d-b492-4541-927e-ca9a3a6d1645 req-f8577c57-388b-40ee-82a7-004e74a547d6 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:07.473740 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-cc49d18d-b492-4541-927e-ca9a3a6d1645 req-f8577c57-388b-40ee-82a7-004e74a547d6 service nova] Creating event network-vif-plugged:3f3401c7-6747-49bb-ab1a-bca327762ba3 for instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 on hv-cinder-81556 Oct 27 01:29:07.478799 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-cc49d18d-b492-4541-927e-ca9a3a6d1645 req-f8577c57-388b-40ee-82a7-004e74a547d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029717 Oct 27 01:29:07.479344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 626/1220] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:29:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:08.005812 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:08.006448 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:08.012670 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:08.013112 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:08.013874 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:08.014337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:08.287965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:08.295345 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-2e68b9a8-1f93-4984-8602-a44ed6df91f2 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.293821 Oct 27 01:29:08.295907 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 595/1221] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:08 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:09.313864 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:09.314544 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:09.321323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:09.321764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:09.322555 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:09.322987 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:09.494929 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:09.502115 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-27dd13c5-a648-4d4a-9b77-681e4f1a666b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.192859 Oct 27 01:29:09.502683 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 627/1222] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:09 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:10.519382 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:10.519965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:10.526343 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:10.526791 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:10.527561 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:10.527997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:10.649337 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:10.656547 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-5e488741-cd60-4aeb-bb1a-bf08380193b9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.141027 Oct 27 01:29:10.657106 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 596/1223] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:10 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:11.674122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:11.674781 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:11.681652 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:11.682132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:11.682953 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:11.683386 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:11.802295 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:11.810684 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-ffb94570-52ac-4152-96b5-d87cf82eb4aa tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1265 microversion: 2.1 time: 0.140291 Oct 27 01:29:11.811313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 628/1224] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:11 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:12.827736 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:12.828315 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:12.834733 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:12.835808 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:12.836629 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:12.837087 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:12.957690 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:12.965160 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-bb74966c-cbc7-49af-978e-1a9ee5b04374 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1452 microversion: 2.1 time: 0.141215 Oct 27 01:29:12.965718 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 597/1225] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:12 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:12.980972 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:12.981710 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:12.988005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:12.988451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:12.989216 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:12.989645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:13.112568 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:13.120834 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8f621bc7-4253-4fa8-b736-1df6e6473814 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1452 microversion: 2.1 time: 0.143456 Oct 27 01:29:13.121407 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 629/1226] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:12 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:15.023068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-401decfd-b0e7-4aa5-b820-0023d50c82fc req-27f860e8-fad4-4351-97be-1c80d7d0a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532", "tag": "3f3401c7-6747-49bb-ab1a-bca327762ba3"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:15.024771 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:15.024771 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:29:15.031945 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-401decfd-b0e7-4aa5-b820-0023d50c82fc req-27f860e8-fad4-4351-97be-1c80d7d0a6ee service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:15.032725 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-401decfd-b0e7-4aa5-b820-0023d50c82fc req-27f860e8-fad4-4351-97be-1c80d7d0a6ee service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:15.044013 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-401decfd-b0e7-4aa5-b820-0023d50c82fc req-27f860e8-fad4-4351-97be-1c80d7d0a6ee service nova] Creating event network-changed:3f3401c7-6747-49bb-ab1a-bca327762ba3 for instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 on hv-cinder-81556 Oct 27 01:29:15.051424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-401decfd-b0e7-4aa5-b820-0023d50c82fc req-27f860e8-fad4-4351-97be-1c80d7d0a6ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030306 Oct 27 01:29:15.051424 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 598/1227] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:29:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:16.621743 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:16.622372 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:16.628709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:16.629237 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:16.630090 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:16.630588 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:16.655710 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:29:16.966931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c5da97ae-c61b-4756-9baa-2058b8c0c3f6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 204 len: 0 microversion: 2.1 time: 0.348971 Oct 27 01:29:16.967479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 630/1228] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:29:16 2021] DELETE /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:29:16.977128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:16.978509 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:16.984867 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:16.985306 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:16.986107 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:16.986530 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:17.066645 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-ddf8590b-7e7a-46a0-a1ce-368b5de63ff3 req-153d4f3a-ad6b-4417-9b31-96416c80bd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:17.068575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:17.068575 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:29:17.077317 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ddf8590b-7e7a-46a0-a1ce-368b5de63ff3 req-153d4f3a-ad6b-4417-9b31-96416c80bd8c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:17.077838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-ddf8590b-7e7a-46a0-a1ce-368b5de63ff3 req-153d4f3a-ad6b-4417-9b31-96416c80bd8c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:17.091766 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-ddf8590b-7e7a-46a0-a1ce-368b5de63ff3 req-153d4f3a-ad6b-4417-9b31-96416c80bd8c service nova] Creating event network-changed:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:29:17.098330 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-ddf8590b-7e7a-46a0-a1ce-368b5de63ff3 req-153d4f3a-ad6b-4417-9b31-96416c80bd8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035965 Oct 27 01:29:17.099087 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 631/1229] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:17.125959 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:17.135919 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-f8ba2e23-faf9-4516-b825-a6868c529bdf tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1567 microversion: 2.1 time: 0.163447 Oct 27 01:29:17.138082 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 599/1230] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:16 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:18.154927 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:18.155529 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:18.161451 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:18.161888 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:18.162656 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:18.163082 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:18.285452 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:18.292830 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0540cbdb-c620-4414-947c-a4ef2bab0fe7 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1449 microversion: 2.1 time: 0.142492 Oct 27 01:29:18.293388 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 632/1231] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:18 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1449 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:18.862814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:29:18.863330 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:29:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:29:19.311784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:19.311784 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:19.321414 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:19.324338 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:19.324338 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:19.324338 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:19.367475 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-7cceaa2a-efd2-42e2-b42f-d07f8688ddd2 req-27ac1bd2-27bd-4d14-8a08-b2a5dd8aeccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59a1076-7156-48a7-8e09-75b55aac1a27", "name": "network-vif-deleted", "tag": "90eb633a-ee1a-4e18-995e-ca5fcbcb3ded"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:19.369135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:19.369135 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:29:19.376397 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7cceaa2a-efd2-42e2-b42f-d07f8688ddd2 req-27ac1bd2-27bd-4d14-8a08-b2a5dd8aeccd service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:19.376838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-7cceaa2a-efd2-42e2-b42f-d07f8688ddd2 req-27ac1bd2-27bd-4d14-8a08-b2a5dd8aeccd service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:19.388086 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-7cceaa2a-efd2-42e2-b42f-d07f8688ddd2 req-27ac1bd2-27bd-4d14-8a08-b2a5dd8aeccd service nova] Creating event network-vif-deleted:90eb633a-ee1a-4e18-995e-ca5fcbcb3ded for instance b59a1076-7156-48a7-8e09-75b55aac1a27 on hv-cinder-81556 Oct 27 01:29:19.392843 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-7cceaa2a-efd2-42e2-b42f-d07f8688ddd2 req-27ac1bd2-27bd-4d14-8a08-b2a5dd8aeccd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028983 Oct 27 01:29:19.393479 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 633/1232] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:29:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:29:19.404401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:19.409275 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a035fcef-0947-4fb5-b294-d0c4ceb1532e tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1382 microversion: 2.1 time: 0.103337 Oct 27 01:29:19.409981 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 600/1233] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:19 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1382 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:20.427536 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:20.428262 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:20.434171 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:20.434672 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:20.435428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:20.435860 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:20.467026 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:20.467469 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:20.467947 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lazy-loading 'fault' on Instance uuid b59a1076-7156-48a7-8e09-75b55aac1a27 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:29:20.508748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5e8cd9e794460f805ce9e5b70edd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d6d08d1ae14a628663fb4124cfccc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:20.516361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-dc9ea053-bcdd-4c03-91db-da8e53531797 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 200 len: 1224 microversion: 2.1 time: 0.093299 Oct 27 01:29:20.516935 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 634/1234] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:20 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:21.533312 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:21.533905 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] [instance: b59a1076-7156-48a7-8e09-75b55aac1a27] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:29:21.540199 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:21.541169 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:21.541993 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:29:21.542480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:29:21.555379 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] HTTP exception thrown: Instance b59a1076-7156-48a7-8e09-75b55aac1a27 could not be found. Oct 27 01:29:21.555962 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Returning 404 to user: Instance b59a1076-7156-48a7-8e09-75b55aac1a27 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:29:21.557456 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-d0d28d76-1165-4d47-8de5-bb8d7e3725c6 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27" status: 404 len: 111 microversion: 2.1 time: 0.027894 Oct 27 01:29:21.558080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 601/1235] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:29:21 2021] GET /compute/v2.1/servers/b59a1076-7156-48a7-8e09-75b55aac1a27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:29:21.765805 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-81fae9d7-8ee7-4654-a8d1-f75e85c372f5 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] Calling method '.version_select at 0x7f1d363fd9d0>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:21.836012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-81fae9d7-8ee7-4654-a8d1-f75e85c372f5 tempest-TestShelveInstance-759073893 tempest-TestShelveInstance-759073893-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1671639713" status: 202 len: 0 microversion: 2.1 time: 0.073874 Oct 27 01:29:21.836601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 635/1236] 10.222.0.32 () {58 vars in 1253 bytes} [Wed Oct 27 01:29:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1671639713 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:30:50.609068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-487852287", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2129270094", "security_groups": [{"name": "tempest-secgroup-smoke-461718875"}], "block_device_mapping_v2": [{"uuid": "61dd4a09-7864-463e-962a-353bf7d3d151", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6e401b1-a90b-4326-8b49-61e14b7b154a"}]}} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:50.704577 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.network.neutron [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] validate_networks() for [('d6e401b1-a90b-4326-8b49-61e14b7b154a', None, None, None, None, None)] {{(pid=116349) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 01:30:51.355827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:30:51.356292 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image limits 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:30:51.356753 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Flavor pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:30:51.357161 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Image pref 0:0:0 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:30:51.358575 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.virt.hardware [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:30:51.367023 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:51.367471 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:51.368270 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:51.368708 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:51.385760 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 01:30:51.390011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.quota [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Getting quotas for user eb7fe651d1c84f28a9267a543d0e2497 and project 80ccd2038569468b9d4f7a063fb346c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116349) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 01:30:51.444063 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Going to run 1 instances... {{(pid=116349) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 01:30:51.446198 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61dd4a09-7864-463e-962a-353bf7d3d151',volume_size=None,volume_type=None)] {{(pid=116349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 01:30:51.862617 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c1a91e86-168d-481e-b19c-61047721179b tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.259033 Oct 27 01:30:51.866144 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 602/1237] 10.222.0.32 () {60 vars in 1146 bytes} [Wed Oct 27 01:30:50 2021] POST /compute/v2.1/servers => generated 405 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:30:51.874432 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a94fef29-8b4f-4d50-98b2-efc6edb66d9e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:51.875042 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a94fef29-8b4f-4d50-98b2-efc6edb66d9e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:51.928344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a94fef29-8b4f-4d50-98b2-efc6edb66d9e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:51.935810 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a94fef29-8b4f-4d50-98b2-efc6edb66d9e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1094 microversion: 2.1 time: 0.066606 Oct 27 01:30:51.936360 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 636/1238] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:51 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:52.952534 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4e5aae69-99ab-4e07-9301-95113aaa44ba tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:52.953235 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4e5aae69-99ab-4e07-9301-95113aaa44ba tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:53.006638 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4e5aae69-99ab-4e07-9301-95113aaa44ba tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:53.013120 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4e5aae69-99ab-4e07-9301-95113aaa44ba tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1094 microversion: 2.1 time: 0.064541 Oct 27 01:30:53.014357 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 603/1239] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:52 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:54.030088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a64ed83d-82e8-433a-a636-fcf3160dc7a9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:54.030698 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a64ed83d-82e8-433a-a636-fcf3160dc7a9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:54.079714 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a64ed83d-82e8-433a-a636-fcf3160dc7a9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:54.086193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a64ed83d-82e8-433a-a636-fcf3160dc7a9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1094 microversion: 2.1 time: 0.060410 Oct 27 01:30:54.086697 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 637/1240] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:54 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1094 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:55.103506 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-70060c70-7da0-4b37-8bcb-897100237615 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:55.104140 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-70060c70-7da0-4b37-8bcb-897100237615 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:55.161402 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-70060c70-7da0-4b37-8bcb-897100237615 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:55.167726 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-70060c70-7da0-4b37-8bcb-897100237615 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1094 microversion: 2.1 time: 0.067883 Oct 27 01:30:55.168277 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 604/1241] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:55 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:56.184842 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:56.186225 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:56.192416 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:56.192884 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:56.193633 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:56.194088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:56.251699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:56.259064 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8067c6d9-3839-4da3-bb10-943d7ce4d708 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1144 microversion: 2.1 time: 0.077936 Oct 27 01:30:56.259636 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 638/1242] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:56 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:57.281470 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:57.282068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:57.289016 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:57.289461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:57.290334 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:57.290770 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:57.350128 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:57.358061 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4da22f9f-d37f-4874-a56c-e7dcbcd6d384 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1192 microversion: 2.1 time: 0.079814 Oct 27 01:30:57.358610 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 605/1243] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:57 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:58.379946 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:58.380601 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:58.390327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:58.390327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:58.390327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:58.390327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:58.497616 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:58.504838 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-7e782b6e-1888-425e-84bd-b6e2823ae3cd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1210 microversion: 2.1 time: 0.128513 Oct 27 01:30:58.505398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 639/1244] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:58 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:59.522432 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:59.525369 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:30:59.530205 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:59.530614 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:59.531415 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:59.531847 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:59.679237 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:59.687987 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-6b8063e0-6f2b-4679-937d-345dcbca6982 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.169208 Oct 27 01:30:59.688688 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 606/1245] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:30:59 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:59.704784 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-8964d90b-c423-406d-b62d-4dfaf2e60a2b req-336e358b-428f-4132-9c89-f30976fe4b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d8bd7f-8b32-4025-87f4-fabe3ca13036", "tag": "ce3b5450-8a36-4435-a4eb-861f5da1cdd0"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:59.706561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:30:59.706561 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:30:59.714653 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-8964d90b-c423-406d-b62d-4dfaf2e60a2b req-336e358b-428f-4132-9c89-f30976fe4b2b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:30:59.715102 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-8964d90b-c423-406d-b62d-4dfaf2e60a2b req-336e358b-428f-4132-9c89-f30976fe4b2b service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:30:59.727122 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-8964d90b-c423-406d-b62d-4dfaf2e60a2b req-336e358b-428f-4132-9c89-f30976fe4b2b service nova] Creating event network-changed:ce3b5450-8a36-4435-a4eb-861f5da1cdd0 for instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 on hv-cinder-81556 Oct 27 01:30:59.732534 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-8964d90b-c423-406d-b62d-4dfaf2e60a2b req-336e358b-428f-4132-9c89-f30976fe4b2b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179480 Oct 27 01:30:59.733700 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 640/1246] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:31:00.705908 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:00.706517 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:00.712820 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:00.713265 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:00.714053 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:00.714495 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:00.837560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:00.845652 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-295232b1-6862-481e-b9dc-e428d6ad8fe3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.143599 Oct 27 01:31:00.846254 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 607/1247] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:00 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:01.051230 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:31:01.051670 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:31:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:31:01.864008 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:01.864696 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:01.871155 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:01.871595 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:01.872344 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:01.872769 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:01.994332 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:02.002005 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-a2f4b259-d62a-4143-9d86-611d0d4d47fd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.142314 Oct 27 01:31:02.002530 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 641/1248] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:01 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:03.018672 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:03.019287 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:03.025511 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:03.025953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:03.026750 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:03.027183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:03.147080 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:03.154261 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-8d8ea2d0-70a0-47d1-9eb8-d11f35c4a5df tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.139340 Oct 27 01:31:03.154827 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 608/1249] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:03 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:04.170890 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:04.171525 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:04.177726 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:04.178204 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:04.178970 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:04.179398 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:04.297817 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:04.304997 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-8e88c999-6e72-43bc-a178-b10e54620df0 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.137851 Oct 27 01:31:04.305559 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 642/1250] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:04 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:05.321747 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:05.322355 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:05.328965 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:05.329401 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:05.330183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:05.330611 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:05.451161 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:05.458348 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-dadc356b-8f2e-4e37-8e52-e96a2e5f63e9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.140229 Oct 27 01:31:05.458904 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 609/1251] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:05 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:06.475853 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:06.476452 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:06.483019 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:06.484098 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:06.484891 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:06.485327 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:06.607012 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:06.616704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-09d21821-0289-4cd3-9752-35fb98c363d7 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.144414 Oct 27 01:31:06.617313 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 643/1252] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:06 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:07.633427 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:07.634011 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:07.640361 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:07.640797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:07.641562 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:07.641997 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:07.759550 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:07.766912 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-442a3a99-532f-441a-b70c-da6bc6e54d31 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.137066 Oct 27 01:31:07.767478 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 610/1253] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:07 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:08.784363 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:08.785163 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:08.791224 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:08.791668 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:08.792428 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:08.792849 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:08.917911 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:08.925974 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c6b2976d-ec4b-489a-8d4c-b9bf3da33b22 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.145602 Oct 27 01:31:08.926577 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 644/1254] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:08 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:09.942582 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:09.943183 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:09.949814 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:09.950283 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:09.951043 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:09.951999 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:10.069139 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:10.076209 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-594bb018-d5af-4ced-ad91-9c1b5958e69c tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.137335 Oct 27 01:31:10.077381 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 611/1255] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:09 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:10.500476 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-44ab706f-3e38-427d-ad4d-543bf2d0b60f req-b1fc19e1-b077-4589-acff-aaaa4c9b22ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d8bd7f-8b32-4025-87f4-fabe3ca13036", "name": "network-vif-plugged", "status": "completed", "tag": "ce3b5450-8a36-4435-a4eb-861f5da1cdd0"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:10.502120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:31:10.502120 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:31:10.508796 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-44ab706f-3e38-427d-ad4d-543bf2d0b60f req-b1fc19e1-b077-4589-acff-aaaa4c9b22ba service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:10.509259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-44ab706f-3e38-427d-ad4d-543bf2d0b60f req-b1fc19e1-b077-4589-acff-aaaa4c9b22ba service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:10.520000 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-44ab706f-3e38-427d-ad4d-543bf2d0b60f req-b1fc19e1-b077-4589-acff-aaaa4c9b22ba service nova] Creating event network-vif-plugged:ce3b5450-8a36-4435-a4eb-861f5da1cdd0 for instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 on hv-cinder-81556 Oct 27 01:31:10.524907 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-44ab706f-3e38-427d-ad4d-543bf2d0b60f req-b1fc19e1-b077-4589-acff-aaaa4c9b22ba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081634 Oct 27 01:31:10.525472 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 645/1256] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:11.093984 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:11.094623 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:11.100516 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:11.100958 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:11.101714 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:11.102180 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:11.223034 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:11.230228 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a8cc82eb-53c8-412f-b3a4-04af843f8c38 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1265 microversion: 2.1 time: 0.140723 Oct 27 01:31:11.230790 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 612/1257] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:11 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:12.248185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:12.249540 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:12.255625 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:12.256072 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:12.256835 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:12.257270 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:12.379926 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:12.387207 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-62e2ba35-cba7-45e9-ba26-cef800a55bb1 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1452 microversion: 2.1 time: 0.143701 Oct 27 01:31:12.387774 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 646/1258] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:12 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:12.402909 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:12.403521 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:31:12.410480 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:12.410927 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:12.411691 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:12.412127 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:12.528278 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:12.535932 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b652915f-7bde-4b5c-92d1-628f54b4eda9 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1452 microversion: 2.1 time: 0.136648 Oct 27 01:31:12.536493 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 613/1259] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:31:12 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:14.433446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-5d7fd7dc-71f2-42df-af63-6a73844780ec req-2e551a16-bc4a-47ef-b3a9-975696dabe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d8bd7f-8b32-4025-87f4-fabe3ca13036", "tag": "ce3b5450-8a36-4435-a4eb-861f5da1cdd0"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:14.433446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:31:14.433446 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:31:14.439705 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5d7fd7dc-71f2-42df-af63-6a73844780ec req-2e551a16-bc4a-47ef-b3a9-975696dabe62 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:31:14.440203 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-5d7fd7dc-71f2-42df-af63-6a73844780ec req-2e551a16-bc4a-47ef-b3a9-975696dabe62 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:31:14.450813 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-5d7fd7dc-71f2-42df-af63-6a73844780ec req-2e551a16-bc4a-47ef-b3a9-975696dabe62 service nova] Creating event network-changed:ce3b5450-8a36-4435-a4eb-861f5da1cdd0 for instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 on hv-cinder-81556 Oct 27 01:31:14.456046 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-5d7fd7dc-71f2-42df-af63-6a73844780ec req-2e551a16-bc4a-47ef-b3a9-975696dabe62 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030230 Oct 27 01:31:14.456991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 647/1260] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:31:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:31:27.408764 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:31:27.409445 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:31:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:32:38.881933 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:32:38.882744 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:32:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:32:42.355756 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:42.356393 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:42.356514 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: ERROR oslo.messaging._drivers.impl_rabbit [-] [19394dc5-7774-42e1-819a-216daf1d659f] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 01:32:42.363019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:42.363019 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:42.363734 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:42.364162 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:42.391429 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Going to try to terminate instance {{(pid=116349) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:32:42.496114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-760a39ac-2f3c-41e5-b285-0a9d3aa25cc6 req-5edc7e4b-82ab-4117-a254-df60e204495f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d8bd7f-8b32-4025-87f4-fabe3ca13036", "tag": "ce3b5450-8a36-4435-a4eb-861f5da1cdd0"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:42.497914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:42.497914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:32:42.506014 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-760a39ac-2f3c-41e5-b285-0a9d3aa25cc6 req-5edc7e4b-82ab-4117-a254-df60e204495f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:42.506565 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-760a39ac-2f3c-41e5-b285-0a9d3aa25cc6 req-5edc7e4b-82ab-4117-a254-df60e204495f service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:42.518080 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-760a39ac-2f3c-41e5-b285-0a9d3aa25cc6 req-5edc7e4b-82ab-4117-a254-df60e204495f service nova] Creating event network-changed:ce3b5450-8a36-4435-a4eb-861f5da1cdd0 for instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 on hv-cinder-81556 Oct 27 01:32:42.523326 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-760a39ac-2f3c-41e5-b285-0a9d3aa25cc6 req-5edc7e4b-82ab-4117-a254-df60e204495f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168838 Oct 27 01:32:42.523919 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 648/1261] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:42.711490 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-4a6f7420-2d74-4e55-a41d-3892205bff94 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 204 len: 0 microversion: 2.1 time: 0.359863 Oct 27 01:32:42.712062 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 614/1262] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:32:42 2021] DELETE /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:32:42.722289 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:42.728914 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:42.729437 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:42.729878 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:42.730664 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:42.731088 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:42.862381 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:42.870105 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-c3505da8-69a6-4457-943a-668d691e27a4 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1577 microversion: 2.1 time: 0.152036 Oct 27 01:32:42.870991 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 649/1263] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:42 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:43.890631 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:43.891326 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:43.897593 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:43.898065 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:43.898830 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:43.899263 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:44.020536 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:44.027780 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a3077d22-7222-4782-82cc-10cbbae85e1e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1458 microversion: 2.1 time: 0.141838 Oct 27 01:32:44.029022 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 615/1264] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:43 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1458 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:45.032420 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [req-9c019b03-ea3f-4d46-8d5f-e640014d5015 req-cade76c4-76a0-4db1-a28e-f722fd4468e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d8bd7f-8b32-4025-87f4-fabe3ca13036", "name": "network-vif-deleted", "tag": "ce3b5450-8a36-4435-a4eb-861f5da1cdd0"}]} {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:45.033931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:45.033931 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: warnings.warn(msg) Oct 27 01:32:45.044380 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:45.045048 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:45.051386 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:45.052090 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:45.052859 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:45.053291 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:45.054193 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] [19394dc5-7774-42e1-819a-216daf1d659f] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 59302. Oct 27 01:32:45.058746 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-9c019b03-ea3f-4d46-8d5f-e640014d5015 req-cade76c4-76a0-4db1-a28e-f722fd4468e4 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:45.059185 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [req-9c019b03-ea3f-4d46-8d5f-e640014d5015 req-cade76c4-76a0-4db1-a28e-f722fd4468e4 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:45.070350 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.compute.server_external_events [req-9c019b03-ea3f-4d46-8d5f-e640014d5015 req-cade76c4-76a0-4db1-a28e-f722fd4468e4 service nova] Creating event network-vif-deleted:ce3b5450-8a36-4435-a4eb-861f5da1cdd0 for instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 on hv-cinder-81556 Oct 27 01:32:45.075889 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [req-9c019b03-ea3f-4d46-8d5f-e640014d5015 req-cade76c4-76a0-4db1-a28e-f722fd4468e4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046886 Oct 27 01:32:45.076674 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 650/1265] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:45.117535 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:45.125560 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-b75eb029-1ccd-4635-a9ed-1f045041e553 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1391 microversion: 2.1 time: 0.084813 Oct 27 01:32:45.126191 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 616/1266] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:45 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1391 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:46.143399 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:46.144238 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:46.150634 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:46.151070 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:46.151820 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:46.152248 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:46.181807 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:46.182218 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:46.182651 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.objects.instance [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lazy-loading 'fault' on Instance uuid 18d8bd7f-8b32-4025-87f4-fabe3ca13036 {{(pid=116348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:32:46.221631 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:46.228704 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-db6bb816-2aa2-4d6c-94b5-afc088543dfd tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 200 len: 1230 microversion: 2.1 time: 0.089318 Oct 27 01:32:46.229269 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 651/1267] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:46 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:32:47.245290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:47.245880 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 18d8bd7f-8b32-4025-87f4-fabe3ca13036] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:47.252321 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:47.252705 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:47.253474 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:47.253902 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:47.266686 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] HTTP exception thrown: Instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 could not be found. Oct 27 01:32:47.267262 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Returning 404 to user: Instance 18d8bd7f-8b32-4025-87f4-fabe3ca13036 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:32:47.268068 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-cdc224a8-1b0c-4ac9-b650-820d0b31b4ef tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036" status: 404 len: 111 microversion: 2.1 time: 0.026467 Oct 27 01:32:47.268581 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 617/1268] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:47 2021] GET /compute/v2.1/servers/18d8bd7f-8b32-4025-87f4-fabe3ca13036 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:50.820083 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:50.820615 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:50.822785 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-8d270d2d-4e17-4915-9b2b-111034f6ea76 req-719fdf99-a378-45a4-9e52-8f7d8ec4547c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532", "tag": "3f3401c7-6747-49bb-ab1a-bca327762ba3"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:50.824998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:50.824998 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:32:50.827206 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:50.827661 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:50.828460 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:50.829139 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:50.832910 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-8d270d2d-4e17-4915-9b2b-111034f6ea76 req-719fdf99-a378-45a4-9e52-8f7d8ec4547c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:50.833557 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-8d270d2d-4e17-4915-9b2b-111034f6ea76 req-719fdf99-a378-45a4-9e52-8f7d8ec4547c service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:50.849555 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-8d270d2d-4e17-4915-9b2b-111034f6ea76 req-719fdf99-a378-45a4-9e52-8f7d8ec4547c service nova] Creating event network-changed:3f3401c7-6747-49bb-ab1a-bca327762ba3 for instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 on hv-cinder-81556 Oct 27 01:32:50.855003 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-8d270d2d-4e17-4915-9b2b-111034f6ea76 req-719fdf99-a378-45a4-9e52-8f7d8ec4547c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036142 Oct 27 01:32:50.855596 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 618/1269] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:50.860169 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Going to try to terminate instance {{(pid=116348) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 01:32:51.214201 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-740abc34-4db9-46d7-830b-5ebca4b20b4e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 204 len: 0 microversion: 2.1 time: 0.398150 Oct 27 01:32:51.215311 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 652/1270] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:32:50 2021] DELETE /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:32:51.223992 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:51.224683 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:51.230612 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:51.231093 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:51.231883 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:51.232752 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:51.360716 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:51.368528 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a5de835d-b6f4-486f-8d68-d10e04d9976e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1577 microversion: 2.1 time: 0.148413 Oct 27 01:32:51.369201 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 619/1271] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:51 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:52.387132 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:52.387812 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:52.394013 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:52.394508 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:52.395255 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:52.395679 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:52.517034 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:52.524259 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-1faf9014-f3d9-4c78-b521-ef7f06b4eaaf tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1458 microversion: 2.1 time: 0.141092 Oct 27 01:32:52.524824 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 653/1272] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:52 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1458 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:53.523465 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [req-1a4f7e9e-03d2-4dd0-ac12-ba26581fc403 req-4898d3eb-87a6-4301-8172-712591af2965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532", "name": "network-vif-deleted", "tag": "3f3401c7-6747-49bb-ab1a-bca327762ba3"}]} {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:53.524953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:53.524953 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: warnings.warn(msg) Oct 27 01:32:53.532823 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-1a4f7e9e-03d2-4dd0-ac12-ba26581fc403 req-4898d3eb-87a6-4301-8172-712591af2965 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:53.533255 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [req-1a4f7e9e-03d2-4dd0-ac12-ba26581fc403 req-4898d3eb-87a6-4301-8172-712591af2965 service nova] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:53.540350 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:53.540965 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:53.545863 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.compute.server_external_events [req-1a4f7e9e-03d2-4dd0-ac12-ba26581fc403 req-4898d3eb-87a6-4301-8172-712591af2965 service nova] Creating event network-vif-deleted:3f3401c7-6747-49bb-ab1a-bca327762ba3 for instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 on hv-cinder-81556 Oct 27 01:32:53.548046 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:53.548541 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:53.549323 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:53.549761 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [req-1a4f7e9e-03d2-4dd0-ac12-ba26581fc403 req-4898d3eb-87a6-4301-8172-712591af2965 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029857 Oct 27 01:32:53.549880 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:53.550388 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 620/1273] 10.222.0.32 () {64 vars in 1317 bytes} [Wed Oct 27 01:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:53.609856 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.policy [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116348) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:53.617174 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-cba9f3a3-b42b-4b5e-bfbc-679770e4179e tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1391 microversion: 2.1 time: 0.080508 Oct 27 01:32:53.617748 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 654/1274] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:53 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1391 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:32:54.635109 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:54.635797 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:54.641899 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:54.642375 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:54.643137 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:54.643571 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:54.673324 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:54.673809 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:54.674290 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.objects.instance [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lazy-loading 'fault' on Instance uuid e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 {{(pid=116349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 01:32:54.713730 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.policy [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7fe651d1c84f28a9267a543d0e2497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ccd2038569468b9d4f7a063fb346c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116349) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:54.721101 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-a6e55bd4-d659-4816-9e36-4d5c84cf6f71 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 200 len: 1230 microversion: 2.1 time: 0.090577 Oct 27 01:32:54.721661 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 621/1275] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:54 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:55.738294 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:55.738857 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:55.745261 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:55.745706 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:55.746499 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:55.746932 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:55.760600 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] HTTP exception thrown: Instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 could not be found. Oct 27 01:32:55.761172 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Returning 404 to user: Instance e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:32:55.761973 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-0da7eace-403e-4068-bdb7-5d2e8a25f3c3 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532" status: 404 len: 111 microversion: 2.1 time: 0.027714 Oct 27 01:32:55.762521 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 655/1276] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:55 2021] GET /compute/v2.1/servers/e4ac5ca7-8ba1-4a86-b7ce-ed3aab80f532 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:56.269879 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:56.271461 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.compute.api [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116349) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:56.276686 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:56.277130 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:56.277894 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:56.278365 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG oslo_concurrency.lockutils [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:56.291301 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.wsgi [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] HTTP exception thrown: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. Oct 27 01:32:56.294811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Returning 404 to user: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. {{(pid=116349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:32:56.294811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-c9fdef5a-7be3-4542-a74b-7afb16eadbd5 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 404 len: 111 microversion: 2.1 time: 0.026590 Oct 27 01:32:56.294811 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 622/1277] 10.222.0.32 () {58 vars in 1238 bytes} [Wed Oct 27 01:32:56 2021] DELETE /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:56.301793 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '>' {{(pid=116348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:56.302421 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.compute.api [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] [instance: 7a39a6a3-72c4-4c0d-8bad-2971fbebc302] Fetching instance by UUID {{(pid=116348) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 01:32:56.308212 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:56.308663 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:56.309409 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 01:32:56.310632 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG oslo_concurrency.lockutils [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Lock "9c0f3d9c-730f-4da5-86cf-eb2d1921af52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 01:32:56.324699 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.wsgi [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] HTTP exception thrown: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. Oct 27 01:32:56.325285 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: DEBUG nova.api.openstack.wsgi [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Returning 404 to user: Instance 7a39a6a3-72c4-4c0d-8bad-2971fbebc302 could not be found. {{(pid=116348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 01:32:56.326249 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO nova.api.openstack.requestlog [None req-912eca14-b48c-45bd-8d2d-db5e38be9e1d tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302" status: 404 len: 111 microversion: 2.1 time: 0.028137 Oct 27 01:32:56.326818 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: [pid: 116348|app: 0|req: 656/1278] 10.222.0.32 () {58 vars in 1235 bytes} [Wed Oct 27 01:32:56 2021] GET /compute/v2.1/servers/7a39a6a3-72c4-4c0d-8bad-2971fbebc302 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:57.875775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: DEBUG nova.api.openstack.wsgi [None req-127f0836-287d-460c-afed-94bc31337098 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] Calling method '.version_select at 0x7f1d36129430>' {{(pid=116349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:57.980307 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO nova.api.openstack.requestlog [None req-127f0836-287d-460c-afed-94bc31337098 tempest-TestVolumeBootPattern-744384860 tempest-TestVolumeBootPattern-744384860-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2129270094" status: 202 len: 0 microversion: 2.1 time: 0.108859 Oct 27 01:32:57.980921 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: [pid: 116349|app: 0|req: 623/1279] 10.222.0.32 () {58 vars in 1262 bytes} [Wed Oct 27 01:32:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2129270094 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:34:11.534083 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:34:11.534775 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:34:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:34:21.069643 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:34:21.070114 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:34:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:34:47.427003 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:34:47.427709 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:34:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:35:58.899358 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:35:58.899976 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:35:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:37:31.551540 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:37:31.552257 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:37:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:37:41.088621 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:37:41.089152 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:37:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:37:59.278605 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:37:59.279210 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:37:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:38:02.330336 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:38:02.331548 dv-cinder-815560-1-iscsi devstack@n-api.service[116349]: Wed Oct 27 01:38:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 01:38:07.444361 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:38:07.444901 dv-cinder-815560-1-iscsi devstack@n-api.service[116348]: Wed Oct 27 01:38:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!